Import an entire folder of files from S3

🤖/s3/import allows you to import entire folders of files from your Amazon S3 account with very easy syntax. After the processing is done, you can see which files were imported in the result JSON at the bottom.

⚠️ It seems your browser does not send the referer, which we need to stop people from (ab)using our demos in other websites. If you want to use the demos, please allow your browser to send its referer to us. Adding us to the allowlist of blockers usually helps.

Step 1: Import files from Amazon S3

We are happy to import from whatever storage solution suits you best. Learn more ›

⚠️ It seems your browser does not support the codec used in this video of the page. For demo simplicity we'll link you to the original file, but you may also want to learn how to make videos compatible for all browsers.

BRUNTSFIELD-0.jpg

19 KB · 400 × 400

STOCKBRIDGE-1.jpg

85 KB · 1000 × 1000

-2.jpg

85 KB · 1000 × 1000

[object Object]-3.jpg

19 KB · 400 × 400

desert-4.jpg

1.5 MB · 2560 × 2048

ravi-roshan-383162-5.jpg

1.4 MB · 4096 × 2301

snowflake-6.jpg

131 KB · 1152 × 768

"imported": {
  "robot": "/s3/import",
  "result": true,
  "credentials": "YOUR_AWS_CREDENTIALS",
  "path": "my_folder/"
}

🤖/s3/import

This bot imports whole directories of files from your S3 bucket

Step 2: Resize images to 130×130

We can resize, crop, and (auto-)rotate images, or apply watermarks and other effects, and much more. Learn more ›

⚠️ It seems your browser does not support the codec used in this video of the page. For demo simplicity we'll link you to the original file, but you may also want to learn how to make videos compatible for all browsers.

BRUNTSFIELD-0.jpg

4.7 KB · 130 × 130

STOCKBRIDGE-1.jpg

4.6 KB · 130 × 130

-2.jpg

4.6 KB · 130 × 130

snowflake-3.jpg

36 KB · 130 × 87

desert-4.jpg

11 KB · 130 × 104

ravi-roshan-383162-5.jpg

10 KB · 130 × 73

[object Object]-6.jpg

4.7 KB · 130 × 130

"resized": {
  "robot": "/image/resize",
  "use": "imported",
  "result": true,
  "zoom": false,
  "width": 130,
  "height": 130,
  "imagemagick_stack": "v3.0.0"
}

🤖/image/resize

This bot resizes, crops, changes colorization, rotation, and applies text and watermarks to images

Step 3: Export files to Amazon S3

We export to the storage platform of your choice. Learn more ›

imported

resized

Once all files have been exported, we can ping a URL of your choice with the Assembly status JSON.

"exported": {
  "use": [
    "imported",
    "resized"
  ],
  "robot": "/s3/store",
  "path": "my_resized/",
  "credentials": "YOUR_AWS_CREDENTIALS",
  "url_prefix": "https://demos.transloadit.com/"
}

🤖/s3/store

This bot exports encoding results to Amazon S3

Since this is a store Robot, be sure to use Template Credentials so that any sensitive data is encrypted and stored in our database, making sure that they’re never exposed to any end-user.

Live Demo. See for yourself

This particular demo does not rely on file uploads and is therefore typically not initiated from web browsers. However, just so you can get a feeling for our service, we’re happy to let you run this right here regardless.

Build this in your own language

{
  "steps": {
    "imported": {
      "robot": "/s3/import",
      "result": true,
      "credentials": "YOUR_AWS_CREDENTIALS",
      "path": "my_folder/"
    },
    "resized": {
      "robot": "/image/resize",
      "use": "imported",
      "result": true,
      "zoom": false,
      "width": 130,
      "height": 130,
      "imagemagick_stack": "v3.0.0"
    },
    "exported": {
      "use": ["imported", "resized"],
      "robot": "/s3/store",
      "path": "my_resized/",
      "credentials": "YOUR_AWS_CREDENTIALS",
      "url_prefix": "https://demos.transloadit.com/"
    }
  }
}

# Prerequisites: brew install curl jq || sudo apt install curl jq
# To avoid tampering, use Signature Authentication
echo '{
  "template_id": undefined,
  "auth": {
    "key": "YOUR_TRANSLOADIT_KEY"
  },
  "steps": {
    "imported": {
      "robot": "/s3/import",
      "result": true,
      "credentials": "YOUR_AWS_CREDENTIALS",
      "path": "my_folder/"
    },
    "resized": {
      "robot": "/image/resize",
      "use": "imported",
      "result": true,
      "zoom": false,
      "width": 130,
      "height": 130,
      "imagemagick_stack": "v3.0.0"
    },
    "exported": {
      "use": ["imported", "resized"],
      "robot": "/s3/store",
      "path": "my_resized/",
      "credentials": "YOUR_AWS_CREDENTIALS",
      "url_prefix": "https://demos.transloadit.com/"
    }
  }
}' |curl \
    --request POST \
    --form 'params=<-' \
  https://api2.transloadit.com/assemblies \
|jq

Read docs: cURL

// Install via Swift Package Manager:
// dependencies: [
//   .package(url: "https://github.com/transloadit/TransloaditKit", .upToNextMajor(from: "3.0.0"))
// ]

// Or via CocoaPods:
// pod 'Transloadit', '~> 3.0.0'

// Auth
let credentials = Credentials(key: "YOUR_TRANSLOADIT_KEY")

// Init
let transloadit = Transloadit(credentials: credentials, session: "URLSession.shared")

// Add files to upload
let filesToUpload: [URL] = ...

// Execute
let assembly = transloadit.assembly(steps: [importedStep, resizedStep, exportedStep], andUpload: filesToUpload) { result in
  switch result {
  case .success(let assembly):
    print("Retrieved (assembly)")
  case .failure(let error):
    print("Assembly error (error)")
  }
}.pollAssemblyStatus { result in
  switch result {
  case .success(let assemblyStatus):
    print("Received assemblystatus (assemblyStatus)")
  case .failure(let error):
    print("Caught polling error (error)")
  }

Read docs: TransloaditKit

<body>
  <form action="/uploads" enctype="multipart/form-data" method="POST">
    <input type="file" name="my_file" multiple="multiple" />
  </form>

  <script src="//ajax.googleapis.com/ajax/libs/jquery/3.2.0/jquery.min.js"></script>
  <script src="//assets.transloadit.com/js/jquery.transloadit2-v3-latest.js"></script>
  <script type="text/javascript">
    $(function () {
      $('form').transloadit({
        wait: true,
        triggerUploadOnFileSelection: true,
        // To avoid tampering, use Signature Authentication:
        // https://transloadit.com/docs/topics/signature-authentication/
        auth: {
          key: 'YOUR_TRANSLOADIT_KEY',
        },
        // It's often better store encoding instructions in your account
        // and use a `template_id` instead of adding these steps inline
        steps: {
          imported: {
            robot: '/s3/import',
            result: true,
            credentials: 'YOUR_AWS_CREDENTIALS',
            path: 'my_folder/',
          },
          resized: {
            robot: '/image/resize',
            use: 'imported',
            result: true,
            zoom: false,
            width: 130,
            height: 130,
            imagemagick_stack: 'v3.0.0',
          },
          exported: {
            use: ['imported', 'resized'],
            robot: '/s3/store',
            path: 'my_resized/',
            credentials: 'YOUR_AWS_CREDENTIALS',
            url_prefix: 'https://demos.transloadit.com/',
          },
        },
      })
    })
  </script>
</body>

Read docs: jQuery SDK

<!-- This pulls Uppy from our CDN -->
<!-- For smaller self-hosted bundles, install Uppy and plugins manually: -->
<!-- npm i --save @uppy/core @uppy/dashboard @uppy/remote-sources @uppy/transloadit ... -->
<link
  href="https://releases.transloadit.com/uppy/v3.18.0/uppy.min.css"
  rel="stylesheet"
/>
<button id="browse">Select Files</button>
<script type="module">
  import {
    Uppy,
    Dashboard,
    ImageEditor,
    RemoteSources,
    Transloadit,
  } from 'https://releases.transloadit.com/uppy/v3.18.0/uppy.min.mjs'
  const uppy = new Uppy()
    .use(Transloadit, {
      waitForEncoding: true,
      alwaysRunAssembly: true,
      assemblyOptions: {
        params: {
          // To avoid tampering, use Signature Authentication:
          // https://transloadit.com/docs/topics/signature-authentication/
          auth: {
            key: 'YOUR_TRANSLOADIT_KEY',
          },
          // It's often better store encoding instructions in your account
          // and use a `template_id` instead of adding these steps inline
          steps: {
            imported: {
              robot: '/s3/import',
              result: true,
              credentials: 'YOUR_AWS_CREDENTIALS',
              path: 'my_folder/',
            },
            resized: {
              robot: '/image/resize',
              use: 'imported',
              result: true,
              zoom: false,
              width: 130,
              height: 130,
              imagemagick_stack: 'v3.0.0',
            },
            exported: {
              use: ['imported', 'resized'],
              robot: '/s3/store',
              path: 'my_resized/',
              credentials: 'YOUR_AWS_CREDENTIALS',
              url_prefix: 'https://demos.transloadit.com/',
            },
          },
        },
      },
    })
    .use(Dashboard, { trigger: '#browse' })
    .use(ImageEditor, { target: Dashboard })
    .use(RemoteSources, {
      companionUrl: 'https://api2.transloadit.com/companion',
    })
    .on('complete', ({ transloadit }) => {
      // Due to `waitForEncoding:true` this is fired after encoding is done.
      // Alternatively, set `waitForEncoding` to `false` and provide a `notify_url`
      console.log(transloadit) // Array of Assembly Statuses
      transloadit.forEach((assembly) => {
        console.log(assembly.results) // Array of all encoding results
      })
    })
    .on('error', (error) => {
      console.error(error)
    })
</script>

Read docs: Uppy File Uploader

// yarn add transloadit || npm i transloadit

// Import
const Transloadit = require('transloadit')

// Init
const transloadit = new Transloadit({
  authKey: 'YOUR_TRANSLOADIT_KEY',
  authSecret: 'MY_TRANSLOADIT_SECRET',
})

// Set Encoding Instructions
const options = {
  files: {},
  params: {
    steps: {
      imported: {
        robot: '/s3/import',
        result: true,
        credentials: 'YOUR_AWS_CREDENTIALS',
        path: 'my_folder/',
      },
      resized: {
        robot: '/image/resize',
        use: 'imported',
        result: true,
        zoom: false,
        width: 130,
        height: 130,
        imagemagick_stack: 'v3.0.0',
      },
      exported: {
        use: ['imported', 'resized'],
        robot: '/s3/store',
        path: 'my_resized/',
        credentials: 'YOUR_AWS_CREDENTIALS',
        url_prefix: 'https://demos.transloadit.com/',
      },
    },
  },
}

// Execute
const result = await transloadit.createAssembly(options)

// Show results
console.log({ result })

Read docs: Node SDK

# [sudo] npm install transloadify -g

# Auth
export TRANSLOADIT_KEY="YOUR_TRANSLOADIT_KEY"

# Save Encoding Instructions
echo '{
  "steps": {
    "imported": {
      "robot": "/s3/import",
      "result": true,
      "credentials": "YOUR_AWS_CREDENTIALS",
      "path": "my_folder/"
    },
    "resized": {
      "robot": "/image/resize",
      "use": "imported",
      "result": true,
      "zoom": false,
      "width": 130,
      "height": 130,
      "imagemagick_stack": "v3.0.0"
    },
    "exported": {
      "use": ["imported", "resized"],
      "robot": "/s3/store",
      "path": "my_resized/",
      "credentials": "YOUR_AWS_CREDENTIALS",
      "url_prefix": "https://demos.transloadit.com/"
    }
  }
}' > ./steps.json

# Execute
transloadify \
  --steps "./steps.json" \
  --output "./output.example"

Read docs: Transloadify

// composer require transloadit/php-sdk
use transloadit\Transloadit;

$transloadit = new Transloadit([
  "key" => "YOUR_TRANSLOADIT_KEY",
  "secret" => "MY_TRANSLOADIT_SECRET",
]);

// Start the Assembly
$response = $transloadit->createAssembly([
  "files" => [],
  "params" => [
    "steps" => [
      "imported" => [
        "robot" => "/s3/import",
        "result" => true,
        "credentials" => "YOUR_AWS_CREDENTIALS",
        "path" => "my_folder/",
      ],
      "resized" => [
        "robot" => "/image/resize",
        "use" => "imported",
        "result" => true,
        "zoom" => false,
        "width" => 130,
        "height" => 130,
        "imagemagick_stack" => "v3.0.0",
      ],
      "exported" => [
        "use" => ["imported", "resized"],
        "robot" => "/s3/store",
        "path" => "my_resized/",
        "credentials" => "YOUR_AWS_CREDENTIALS",
        "url_prefix" => "https://demos.transloadit.com/",
      ],
    ],
  ],
]);

Read docs: PHP SDK

# gem install transloadit

# $ irb -rubygems
# >> require 'transloadit'
# => true

transloadit = Transloadit.new([
  :key => "YOUR_TRANSLOADIT_KEY",
])

# Set Encoding Instructions
imported = transloadit.step("imported", "/s3/import", [
  :result => true,
  :credentials => "YOUR_AWS_CREDENTIALS",
  :path => "my_folder/"
])

resized = transloadit.step("resized", "/image/resize", [
  :use => "imported",
  :result => true,
  :zoom => false,
  :width => 130,
  :height => 130,
  :imagemagick_stack => "v3.0.0"
])

exported = transloadit.step("exported", "/s3/store", [
  :use => ["imported", "resized"],
  :path => "my_resized/",
  :credentials => "YOUR_AWS_CREDENTIALS",
  :url_prefix => "https://demos.transloadit.com/"
])

transloadit.assembly([
  :steps => [imported, resized, exported]
])

# Add files to upload
files = []


# Start the Assembly
response = assembly.create! *files

until response.finished?
  sleep 1; response.reload!
end

if !response.error?
  # handle success
end

Read docs: Ruby SDK

# pip install pytransloadit
from transloadit import client

tl = client.Transloadit('YOUR_TRANSLOADIT_KEY', 'MY_TRANSLOADIT_SECRET')
assembly = tl.new_assembly()

# Set Encoding Instructions
assembly.add_step("imported", "/s3/import", {
  'result': True,
  'credentials': 'YOUR_AWS_CREDENTIALS',
  'path': 'my_folder/'
})

assembly.add_step("resized", "/image/resize", {
  'use': 'imported',
  'result': True,
  'zoom': False,
  'width': 130,
  'height': 130,
  'imagemagick_stack': 'v3.0.0'
})

assembly.add_step("exported", "/s3/store", {
  'use': ['imported', 'resized'],
  'path': 'my_resized/',
  'credentials': 'YOUR_AWS_CREDENTIALS',
  'url_prefix': 'https://demos.transloadit.com/'
})

# Add files to upload

# Start the Assembly
assembly_response = assembly.create(retries=5, wait=True)

print(assembly_response.data.get('assembly_ssl_url'))
# or:
print(assembly_response.data['assembly_ssl_url'])

Read docs: Python SDK

// go get gopkg.in/transloadit/go-sdk.v1
package main

import (
  "context"
  "fmt"
  "github.com/transloadit/go-sdk"
)

func main() {
  // Create client
  options := transloadit.DefaultConfig
  options.AuthKey = "YOUR_TRANSLOADIT_KEY"
  options.AuthSecret = "MY_TRANSLOADIT_SECRET"
  client := transloadit.NewClient(options)
  
  // Initialize new Assembly
  assembly := transloadit.NewAssembly()
  
  // Set Encoding Instructions
  assembly.AddStep("imported", map[string]interface{}{
    "robot": "/s3/import",
    "result": true,
    "credentials": "YOUR_AWS_CREDENTIALS",
    "path": "my_folder/",
  })
  
  assembly.AddStep("resized", map[string]interface{}{
    "robot": "/image/resize",
    "use": "imported",
    "result": true,
    "zoom": false,
    "width": 130,
    "height": 130,
    "imagemagick_stack": "v3.0.0",
  })
  
  assembly.AddStep("exported", map[string]interface{}{
    "use": ["imported", "resized"],
    "robot": "/s3/store",
    "path": "my_resized/",
    "credentials": "YOUR_AWS_CREDENTIALS",
    "url_prefix": "https://demos.transloadit.com/",
  })
  
  // Add files to upload
  
  
  // Start the Assembly
  info, err := client.StartAssembly(context.Background(), assembly)
  if err != nil {
    panic(err)
  }
  
  // All files have now been uploaded and the Assembly has started but no
  // results are available yet since the conversion has not finished.
  // WaitForAssembly provides functionality for polling until the Assembly
  // has ended.
  info, err = client.WaitForAssembly(context.Background(), info)
  if err != nil {
    panic(err)
  }
  
  fmt.Printf("You can check some results at: ")
  fmt.Printf("  - %s\n", info.Results["imported"][0].SSLURL)
  fmt.Printf("  - %s\n", info.Results["resized"][0].SSLURL)
  fmt.Printf("  - %s\n", info.Results["exported"][0].SSLURL)
}

Read docs: Go SDK

// implementation 'com.transloadit.sdk:transloadit:1.0.0

import com.transloadit.sdk.Assembly;
import com.transloadit.sdk.Transloadit;
import com.transloadit.sdk.exceptions.LocalOperationException;
import com.transloadit.sdk.exceptions.RequestException;
import com.transloadit.sdk.response.AssemblyResponse;
import java.io.File;
import java.util.HashMap;
import java.util.Map;

public class Main {
  public static void main(String[] args) {
    // Initialize the Transloadit client
    Transloadit transloadit = new Transloadit("YOUR_TRANSLOADIT_KEY", "MY_TRANSLOADIT_SECRET");
    
    Assembly assembly = transloadit.newAssembly();
    
    // Set Encoding Instructions
    Map<String, Object> importedStepOptions = new HashMap();
    importedStepOptions.put("result", true);
    importedStepOptions.put("credentials", "YOUR_AWS_CREDENTIALS");
    importedStepOptions.put("path", "my_folder/");
    assembly.addStep("imported", "/s3/import", importedStepOptions);
    
    Map<String, Object> resizedStepOptions = new HashMap();
    resizedStepOptions.put("use", "imported");
    resizedStepOptions.put("result", true);
    resizedStepOptions.put("zoom", false);
    resizedStepOptions.put("width", 130);
    resizedStepOptions.put("height", 130);
    resizedStepOptions.put("imagemagick_stack", "v3.0.0");
    assembly.addStep("resized", "/image/resize", resizedStepOptions);
    
    Map<String, Object> exportedStepOptions = new HashMap();
    exportedStepOptions.put("use", new String[] { "imported", "resized" });
    exportedStepOptions.put("path", "my_resized/");
    exportedStepOptions.put("credentials", "YOUR_AWS_CREDENTIALS");
    exportedStepOptions.put("url_prefix", "https://demos.transloadit.com/");
    assembly.addStep("exported", "/s3/store", exportedStepOptions);
    
    // Add files to upload
    
    
    // Start the Assembly
    try {
      AssemblyResponse response = assembly.save();
    
      // Wait for Assembly to finish executing
      while (!response.isFinished()) {
        response = transloadit.getAssemblyByUrl(response.getSslUrl());
      }
    
      System.out.println(response.getId());
      System.out.println(response.getUrl());
      System.out.println(response.json());
    } catch (RequestException | LocalOperationException e) {
      // Handle exception here
    }
  }
}

Read docs: Java SDK

So many ways to integrate

Transloadit is a service for companies with developers. As a developer, there are many ways you can put us to good use.

Bulk imports

Add one of our import Robots to acquire and transcode massive media libraries.
Handling uploads

We are the experts at reliably handling uploads. We wrote the protocol for it.
Front-end integration

We integrate with web browsers via our next-gen file uploader Uppy and SDKs for Android and iOS.
Back-end integration

Send us batch jobs in any server language using one of our SDKs or directly interfacing with our REST API.
Pingbacks

Configure a notify_url to let your server receive transcoding results JSON in the transloadit POST field.

Get started for free

Free plan with 5 GB encoding credit
Set monthly spending limits
Try without a credit card
Highly available, globally distributed platform
Cancel at any time
Costs displayed for each upload/conversion

Sign up via GitHub or Sign up with email

Try it in your account

Copy these instructions to a Template of your own
(you'll be able to make changes before actually saving)

Copy to Template

Need help? Talk to a human

We are a Swiss Army knife for your files

Import an entire folder of files from S3

Step 1: Import files from Amazon S3

Step 2: Resize images to 130×130

Step 3: Export files to Amazon S3

Live Demo. See for yourself

Build this in your own language

So many ways to integrate

Bulk imports

Handling uploads

Front-end integration

Back-end integration

Pingbacks

Follow us on Twitter:

Star Uppy on GitHub:

What’s happening on Twitter

Try it in your account

Other cool demos

We are a Swiss Army knife for your files

Import an entire folder of files from S3

Step 1: Import files from Amazon S3

Step 2: Resize images to 130×130

Step 3: Export files to Amazon S3

Live Demo. See for yourself

Build this in your own language

So many ways to integrate

Bulk imports

Handling uploads

Front-end integration

Back-end integration

Pingbacks

Share your Transloadit project to earn $300

Get started for free

Follow us on Twitter:

Join 20k+ developers

Get started today

Star Uppy on GitHub:

What’s happening on Twitter

Try it in your account

Other cool demos