將上傳的圖像存儲到AWS S3

Question

我有一個用python/django（REST api）編寫的服務器應用程序，用於接受來自客戶機應用程序的文件上傳。我希望這個上傳的文件存儲在AWS S3中。我也希望文件作爲多部分表單/數據從客戶端上傳。我怎樣才能做到這一點。任何示例代碼應用程序將幫助我理解應該如何完成。請協助。

class FileUploadView(APIView): 
    parser_classes = (FileUploadParser,) 

    def put(self, request, filename, format=None): 
     file_obj = request.data['file'] 
     self.handle_uploaded_file(file_obj) 
     return self.get_response("", True, "", {}) 

    def handle_uploaded_file(self, f): 
     destination = open('<path>', 'wb+') 
     for chunk in f.chunks(): 
      destination.write(chunk) 
     destination.close() 

在此先感謝

Answer 1

看看boto包，它提供了AWS的API：

from boto.s3.connection import S3Connection 
s3 = S3Connection(access_key, secret_key) 
b = s3.get_bucket('<bucket>') 
mp = b.initiate_multipart_upload('<object>') 
for i in range(1, <parts>+1): 
    io = <receive-image-part> # E.g. StringIO 
    mp.upload_part_from_file(io, part_num=i) 
mp.complete_upload() 

Answer 2

如果你想你的上傳直接去AWS S3，您可以使用django-storages和將您的Django文件存儲後端設置爲使用AWS S3。

• django-storages
• django-storages documentation

這將使你的Django項目，以透明地處理存儲於S3，而你不必手動您上傳的文件重新上傳到S3。

存儲設置

您將需要至少這些配置添加到您的Django設置：

# default remote file storage 
DEFAULT_FILE_STORAGE = 'storages.backends.s3boto.S3BotoStorage' 

# aws access keys 
AWS_ACCESS_KEY_ID = 'YOUR-ACCESS-KEY' 
AWS_SECRET_ACCESS_KEY = 'YOUR-SECRET-ACCESS-KEY' 
AWS_BUCKET_NAME = 'your-bucket-name' 
AWS_STORAGE_BUCKET_NAME = AWS_BUCKET_NAME 

示例代碼上傳存儲到遠程存儲

這是一個您使用Django存儲後端的handle_uploaded_file方法將視圖的修改版本保存到遠程文件stination（使用django-storages）。

注意：請務必在您的settings中定義DEFAULT_FILE_STORAGE和AWS密鑰，以便django-storage可以訪問您的存儲桶。

from django.core.files.storage import default_storage 
from django.core.files import File 

# set file i/o chunk size to maximize throughput 
FILE_IO_CHUNK_SIZE = 128 * 2**10 


class FileUploadView(APIView): 
    parser_classes = (FileUploadParser,) 

    def put(self, request, filename, format=None): 
     file_obj = request.data['file'] 
     self.handle_uploaded_file(file_obj) 
     return self.get_response("", True, "", {}) 

    def handle_uploaded_file(self, f): 
     """ 
     Write uploaded file to destination using default storage. 
     """ 
     # set storage object to use Django's default storage 
     storage = default_storage 

     # set the relative path inside your bucket where you want the upload 
     # to end up 
     fkey = 'sub-path-in-your-bucket-to-store-the-file' 

     # determine mime type -- you may want to parse the upload header 
     # to find out the exact MIME type of the upload file. 
     content_type = 'image/jpeg' 

     # write file to remote server 
     # * "file" is a File storage object that will use your 
     # storage backend (in this case, remote storage to AWS S3) 
     # * "media" is a File object created with your upload file 
     file = storage.open(fkey, 'w') 
     storage.headers.update({"Content-Type": content_type}) 
     f = open(path, 'rb') 
     media = File(f) 
     for chunk in media.chunks(chunk_size=FILE_IO_CHUNK_SIZE): 
      file.write(chunk) 
     file.close() 
     media.close() 
     f.close() 

參見如何訪問這裏的遠程存儲更多的解釋和例子：

• django-storages: Amazon S3