After two days of debugging, I finally discovered the problem… The key I was assigning to the object started with a period i.e. ..\images\ABC.jpg, and this caused the error to occur. I wish the API provides more meaningful and relevant error message, alas, I hope this will help someone else out there!
From IAM docs, http://docs.aws.amazon.com/IAM/latest/UserGuide/reference_policies_elements.html#Action Some services do not let you specify actions for individual resources; instead, any actions that you list in the Action or NotAction element apply to all resources in that service. In these cases, you use the wildcard * in the Resource element. With this information, resource should have a value like … Read more
read will return bytes. At least for Python 3, if you want to return a string, you have to decode using the right encoding: import boto3 s3 = boto3.resource(‘s3’) obj = s3.Object(bucket, key) obj.get()[‘Body’].read().decode(‘utf-8’)
A previous answer only mentioned SSL in the context of data transfer and didn’t actually cover authentication. You’re really asking about securely authenticating REST API clients. Unless you’re using TLS client authentication, SSL alone is NOT a viable authentication mechanism for a REST API. SSL without client authc only authenticates the server, which is irrelevant … Read more
Jaminto did a great job of answering the question, but I recently went through the process myself and wanted to expand on Jaminto’s answer. I’m assuming that you already have an EC2 instance created and have associated an Elastic IP Address to it. Step #1: Install vsftpd SSH to your EC2 server. Type: > sudo … Read more
Usually, all you need to do is to “Add CORS Configuration” in your bucket properties. The <CORSConfiguration> comes with some default values. That’s all I needed to solve your problem. Just click “Save” and try again to see if it worked. If it doesn’t, you could also try the code below (from alxrb answer) which … Read more
It seems likely that this bucket was created in a different region, IE not us-west-2. That’s the only time I’ve seen “The bucket you are attempting to access must be addressed using the specified endpoint. Please send all future requests to this endpoint.” US Standard is us-east-1
Amazon S3 is designed for large-capacity, low-cost file storage in one specific geographical region.* The storage and bandwidth costs are quite low. Amazon CloudFront is a Content Delivery Network (CDN) which proxies and caches web data at edge locations as close to users as possible. When end users request an object using this domain name, … Read more
I just tested this and it works: aws s3 –recursive mv s3://<bucketname>/<folder_name_from> s3://<bucket>/<folder_name_to>
Boto 2’s boto.s3.key.Key object used to have an exists method that checked if the key existed on S3 by doing a HEAD request and looking at the the result, but it seems that that no longer exists. You have to do it yourself: import boto3 import botocore s3 = boto3.resource(‘s3’) try: s3.Object(‘my-bucket’, ‘dootdoot.jpg’).load() except botocore.exceptions.ClientError … Read more