Import an entire folder of files from S3

Our /s3/import Robot allows you to import entire folders of files from your Amazon S3 account with very easy syntax. After the processing is done, you can see which files were imported in the result JSON at the bottom.

⚠️ It seems your browser does not send the referer, which we need to stop people from (ab)using our demos in other websites. If you want to use the demos, please allow your browser to send its referer to us. Adding us to the allowlist of blockers usually helps.

1. Import files from Amazon S3

We are happy to import from whatever storage solution suits you best. Learn more ›

⚠️ It seems your browser does not support the codec used in this video of the page. For demo simplicity we'll link you to the original file, but you may also want to learn how to make videos compatible for all browsers.

file-importing-import-an-entire-folder-from-s3-imported-snowflake-0.jpg

134 KB · 1152 × 768

file-importing-import-an-entire-folder-from-s3-imported-desert-1.jpg

1.6 MB · 2560 × 2048

file-importing-import-an-entire-folder-from-s3-imported-ravi-roshan-383162-2.jpg

1.5 MB · 4096 × 2301

"imported": {
  "robot": "/s3/import",
  "result": true,
  "credentials": "YOUR_AWS_CREDENTIALS",
  "path": "my_folder/"
}

/s3/import Robot

This bot imports whole directories of files from your S3 bucket

2. Resize images to 130×130

We can resize, crop, and (auto-)rotate images, or apply watermarks and other effects, and much more. Learn more ›

⚠️ It seems your browser does not support the codec used in this video of the page. For demo simplicity we'll link you to the original file, but you may also want to learn how to make videos compatible for all browsers.

file-importing-import-an-entire-folder-from-s3-resized-desert-0.jpg

12 KB · 130 × 104

file-importing-import-an-entire-folder-from-s3-resized-ravi-roshan-383162-1.jpg

12 KB · 130 × 73

file-importing-import-an-entire-folder-from-s3-resized-snowflake-2.jpg

38 KB · 130 × 87

"resized": {
  "robot": "/image/resize",
  "use": "imported",
  "result": true,
  "zoom": false,
  "width": 130,
  "height": 130,
  "imagemagick_stack": "v2.0.7"
}

/image/resize Robot

This bot resizes, crops, changes colorization, rotation, and applies text and watermarks to images

3. Export files to Amazon S3

We export to the storage platform of your choice. Learn more ›

imported

resized

Once all files have been exported, we can ping a URL of your choice with the Assembly status JSON.

"exported": {
  "use": [
    "imported",
    "resized"
  ],
  "robot": "/s3/store",
  "path": "my_resized/",
  "credentials": "YOUR_AWS_CREDENTIALS",
  "url_prefix": "https://demos.transloadit.com/"
}

/s3/store Robot

This bot exports encoding results to Amazon S3

Since this is a store Robot, be sure to use Template Credentials so that any sensitive data is encrypted and stored in our database, making sure that they’re never exposed to any end-user.

Live Demo. See for yourself

Build this in your own language

{
  "imported": {
    "robot": "/s3/import",
    "result": true,
    "credentials": "YOUR_AWS_CREDENTIALS",
    "path": "my_folder/"
  },
  "resized": {
    "robot": "/image/resize",
    "use": "imported",
    "result": true,
    "zoom": false,
    "width": 130,
    "height": 130,
    "imagemagick_stack": "v2.0.7"
  },
  "exported": {
    "use": [
      "imported",
      "resized"
    ],
    "robot": "/s3/store",
    "path": "my_resized/",
    "credentials": "YOUR_AWS_CREDENTIALS",
    "url_prefix": "https://demos.transloadit.com/"
  }
}

# Prerequisites: brew install curl jq || sudo apt install curl jq
# To avoid tampering, use Signature Authentication
echo '{
  "auth": {
    "key": "YOUR_TRANSLOADIT_KEY"
  },
  "steps": {
    "imported": {
      "robot": "/s3/import",
      "result": true,
      "credentials": "YOUR_AWS_CREDENTIALS",
      "path": "my_folder/"
    },
    "resized": {
      "robot": "/image/resize",
      "use": "imported",
      "result": true,
      "zoom": false,
      "width": 130,
      "height": 130,
      "imagemagick_stack": "v2.0.7"
    },
    "exported": {
      "use": [
        "imported",
        "resized"
      ],
      "robot": "/s3/store",
      "path": "my_resized/",
      "credentials": "YOUR_AWS_CREDENTIALS",
      "url_prefix": "https://demos.transloadit.com/"
    }
  }
}' |curl \
    --request POST \
    --form 'params=<-' \
  https://api2.transloadit.com/assemblies \
|jq

Read docs: cURL

// Add 'Transloadit' to your Podfile, run 'pod install', add credentials to 'Info.plist'
import Arcane
import TransloaditKit

// Set Encoding Instructions
var AssemblySteps: Array = Array<Step>() // An array to hold the Steps

var Step1 = Step (key: "imported") // Create a Step object
Step1?.setValue("/s3/import", forOption: "robot") // Add the details
Step1?.setValue(true, forOption: "result") // Add the details
Step1?.setValue("YOUR_AWS_CREDENTIALS", forOption: "credentials") // Add the details
Step1?.setValue("my_folder/", forOption: "path") // Add the details
AssemblySteps.append(Step1) // Add the Step to the array

var Step2 = Step (key: "resized") // Create a Step object
Step2?.setValue("imported", forOption: "use") // Add the details
Step2?.setValue("/image/resize", forOption: "robot") // Add the details
Step2?.setValue(true, forOption: "result") // Add the details
Step2?.setValue(130, forOption: "height") // Add the details
Step2?.setValue("v2.0.7", forOption: "imagemagick_stack") // Add the details
Step2?.setValue(130, forOption: "width") // Add the details
Step2?.setValue(false, forOption: "zoom") // Add the details
AssemblySteps.append(Step2) // Add the Step to the array

var Step3 = Step (key: "exported") // Create a Step object
Step3?.setValue(["imported","resized"], forOption: "use") // Add the details
Step3?.setValue("/s3/store", forOption: "robot") // Add the details
Step3?.setValue("YOUR_AWS_CREDENTIALS", forOption: "credentials") // Add the details
Step3?.setValue("my_resized/", forOption: "path") // Add the details
Step3?.setValue("https://demos.transloadit.com/", forOption: "url_prefix") // Add the details
AssemblySteps.append(Step3) // Add the Step to the array

// We then create an Assembly Object with the Steps and files
var MyAssembly: Assembly = Assembly(steps: AssemblySteps, andNumberOfFiles: 1)

// These Instructions do not require uploads, otherwise:
// MyAssembly.addFile("./lolcat.jpg")

// Start the Assembly
Transloadit.createAssembly(MyAssembly) 

// Fires after your Assembly has completed
transloadit.assemblyStatusBlock = {(_ completionDictionary: [AnyHashable: Any]) -> Void in
  print("\(completionDictionary.description)")
}

Read docs: TransloaditKit

<body>
  <form action="/uploads" enctype="multipart/form-data" method="POST">
    <input type="file" name="my_file" multiple="multiple" />
  </form>

  <script src="//ajax.googleapis.com/ajax/libs/jquery/3.2.0/jquery.min.js"></script>
  <script src="//assets.transloadit.com/js/jquery.transloadit2-v3-latest.js"></script>
  <script type="text/javascript">
  $(function() {
    $('form').transloadit({
      wait: true,
      triggerUploadOnFileSelection: true,
      params: {
        auth: {
          // To avoid tampering use signatures:
          // https://transloadit.com/docs/api/#authentication
          key: 'YOUR_TRANSLOADIT_KEY',
        },
        // It's often better store encoding instructions in your account
        // and use a `template_id` instead of adding these steps inline
        steps: {
          imported: {
            robot: '/s3/import',
            result: true,
            credentials: 'YOUR_AWS_CREDENTIALS',
            path: 'my_folder/'
          },
          resized: {
            use: 'imported',
            robot: '/image/resize',
            result: true,
            height: 130,
            imagemagick_stack: 'v2.0.7',
            width: 130,
            zoom: false
          },
          exported: {
            use: ['imported','resized'],
            robot: '/s3/store',
            credentials: 'YOUR_AWS_CREDENTIALS',
            path: 'my_resized/',
            url_prefix: 'https://demos.transloadit.com/'
          }
        }
      }
    });
  });
  </script>
</body>

Read docs: jQuery SDK

<!-- This pulls Uppy from our CDN. Alternatively use `npm i @uppy/robodog --save` -->
<!-- if you want smaller self-hosted bundles and/or to use modern JavaScript -->
<link href="//releases.transloadit.com/uppy/robodog/v2.9.1/robodog.min.css" rel="stylesheet">
<script src="//releases.transloadit.com/uppy/robodog/v2.9.1/robodog.min.js"></script>
<button id="browse">Select Files</button>
<script>
  document.getElementById('browse').addEventListener('click', function () {
    var uppy = window.Robodog.pick({
      providers: [ 'instagram', 'url', 'webcam', 'dropbox', 'google-drive', 'facebook', 'onedrive' ],
      waitForEncoding: true,
      alwaysRunAssembly: true, // <-- Since these Instructions do not require uploads
      params: {
        // To avoid tampering, use Signature Authentication
        auth: { key: 'YOUR_TRANSLOADIT_KEY' },
        // To hide your `steps`, use a `template_id` instead
        steps: {
          imported: {
            robot: '/s3/import',
            result: true,
            credentials: 'YOUR_AWS_CREDENTIALS',
            path: 'my_folder/'
          },
          resized: {
            use: 'imported',
            robot: '/image/resize',
            result: true,
            height: 130,
            imagemagick_stack: 'v2.0.7',
            width: 130,
            zoom: false
          },
          exported: {
            use: ['imported', 'resized'],
            robot: '/s3/store',
            credentials: 'YOUR_AWS_CREDENTIALS',
            path: 'my_resized/',
            url_prefix: 'https://demos.transloadit.com/'
          }
        }
      }
    }).then(function (bundle) {
      // Due to `waitForEncoding: true` this is fired after encoding is done.
      // Alternatively, set `waitForEncoding` to `false` and provide a `notify_url`
      // for Async Mode where your back-end receives the encoding results
      // so that your user can be on their way as soon as the upload completes.
      console.log(bundle.transloadit) // Array of Assembly Statuses
      console.log(bundle.results)     // Array of all encoding results
    }).catch(console.error)
  })
</script>

Read docs: Uppy File Uploader

// yarn add transloadit || npm i transloadit --save-exact
const Transloadit = require('transloadit')

const transloadit = new Transloadit({
  authKey: 'YOUR_TRANSLOADIT_KEY',
  authSecret: 'YOUR_TRANSLOADIT_SECRET'
})

// Set Encoding Instructions
const options = {
  files: {
    // These Instructions do not require uploads, otherwise:
    // 'myfile_1': './lolcat.jpg',
  },
  params: {
    steps: {
      imported: {
        robot: '/s3/import',
        result: true,
        credentials: 'YOUR_AWS_CREDENTIALS',
        path: 'my_folder/',
      },
      resized: {
        use: 'imported',
        robot: '/image/resize',
        result: true,
        height: 130,
        imagemagick_stack: 'v2.0.7',
        width: 130,
        zoom: false,
      },
      exported: {
        use: ['imported','resized'],
        robot: '/s3/store',
        credentials: 'YOUR_AWS_CREDENTIALS',
        path: 'my_resized/',
        url_prefix: 'https://demos.transloadit.com/',
      },
    }
  }
}
// Start the Assembly
const result = await transloadit.createAssembly(options)
console.log({ result })

Read docs: Node SDK

[sudo] npm install transloadify -g

export TRANSLOADIT_KEY="YOUR_TRANSLOADIT_KEY"
export TRANSLOADIT_SECRET="YOUR_TRANSLOADIT_SECRET"

# Save Encoding Instructions
echo '{
  "imported": {
    "robot": "/s3/import",
    "result": true,
    "credentials": "YOUR_AWS_CREDENTIALS",
    "path": "my_folder/"
  },
  "resized": {
    "robot": "/image/resize",
    "use": "imported",
    "result": true,
    "zoom": false,
    "width": 130,
    "height": 130,
    "imagemagick_stack": "v2.0.7"
  },
  "exported": {
    "use": [
      "imported",
      "resized"
    ],
    "robot": "/s3/store",
    "path": "my_resized/",
    "credentials": "YOUR_AWS_CREDENTIALS",
    "url_prefix": "https://demos.transloadit.com/"
  }
}' > ./steps.json

transloadify \
  --output "./output.example" \
  --steps "./steps.json"
  # These Instructions do not require uploads, otherwise add: --input "./input.example"

Read docs: Transloadify

// composer require transloadit/php-sdk
use transloadit\Transloadit;
$transloadit = new Transloadit([
  "key" => "YOUR_TRANSLOADIT_KEY",
  "secret" => "YOUR_TRANSLOADIT_SECRET",
]);

// These Instructions do not require uploads, otherwise:
// array_push($files, "./lolcat.jpg")

// Start the Assembly
$response = $transloadit->createAssembly([
  "files" => $files, 
  "params" => [
    "steps" => [
      "imported" => [
        "robot" => "/s3/import",
        "result" => true,
        "credentials" => "YOUR_AWS_CREDENTIALS",
        "path" => "my_folder/",
      ],
      "resized" => [
        "use" => "imported",
        "robot" => "/image/resize",
        "result" => true,
        "height" => 130,
        "imagemagick_stack" => "v2.0.7",
        "width" => 130,
        "zoom" => false,
      ],
      "exported" => [
        "use" => ["imported", "resized"],
        "robot" => "/s3/store",
        "credentials" => "YOUR_AWS_CREDENTIALS",
        "path" => "my_resized/",
        "url_prefix" => "https://demos.transloadit.com/",
      ],
    ],
  ],
]);

Read docs: PHP SDK

# gem install transloadit
transloadit = Transloadit.new(
  :key => "YOUR_TRANSLOADIT_KEY",
  :secret => "YOUR_TRANSLOADIT_SECRET"
)

# Set Encoding Instructions
imported = transloadit.step "imported", "/s3/import",
  :result => true,
  :credentials => "YOUR_AWS_CREDENTIALS",
  :path => "my_folder/"
)
resized = transloadit.step "resized", "/image/resize",
  :use => "imported",
  :result => true,
  :height => 130,
  :imagemagick_stack => "v2.0.7",
  :width => 130,
  :zoom => false
)
exported = transloadit.step "exported", "/s3/store",
  :use => ["imported","resized"],
  :credentials => "YOUR_AWS_CREDENTIALS",
  :path => "my_resized/",
  :url_prefix => "https://demos.transloadit.com/"
)

assembly = transloadit.assembly(
  :steps => [ imported, resized, exported ]
)

# These Instructions do not require uploads, otherwise:
# files.push("./lolcat.jpg")
# Start the Assembly
response = assembly.create! *files

until response.finished?
  sleep 1; response.reload!
end

if !response.error?
  # handle success
end

Read docs: Ruby SDK

# pip install pytransloadit
from transloadit import client

tl = client.Transloadit('YOUR_TRANSLOADIT_KEY', 'YOUR_TRANSLOADIT_SECRET')
assembly = tl.new_assembly()

# Set Encoding Instructions
assembly.add_step('imported', '/s3/import', {
  'result': True,
  'credentials': 'YOUR_AWS_CREDENTIALS',
  'path': 'my_folder/'
})
assembly.add_step('resized', '/image/resize', {
  'use': 'imported',
  'result': True,
  'height': 130,
  'imagemagick_stack': 'v2.0.7',
  'width': 130,
  'zoom': False
})
assembly.add_step('exported', '/s3/store', {
  'use': ['imported','resized'],
  'credentials': 'YOUR_AWS_CREDENTIALS',
  'path': 'my_resized/',
  'url_prefix': 'https://demos.transloadit.com/'
})

# These Instructions do not require uploads, otherwise:
# assembly.add_file(open('./', 'rb'))

# Start the Assembly
assembly_response = assembly.create(retries=5, wait=True)

print(assembly_response.data.get('assembly_ssl_url'))
# or:
print(assembly_response.data['assembly_ssl_url'])

Read docs: Python SDK

// go get gopkg.in/transloadit/go-sdk.v1
package main

import (
	"fmt"

	"gopkg.in/transloadit/go-sdk.v1"
)

options := transloadit.DefaultConfig
options.AuthKey = "YOUR_TRANSLOADIT_KEY"
options.AuthSecret = "YOUR_TRANSLOADIT_SECRET"
client := transloadit.NewClient(options)

// Initialize new Assembly
assembly := transloadit.NewAssembly()

// Set Encoding Instructions
assembly.AddStep("imported", map[string]interface{}{
  "robot": "/s3/import",
  "result": true,
  "credentials": "YOUR_AWS_CREDENTIALS",
  "path": "my_folder/"
})
assembly.AddStep("resized", map[string]interface{}{
  "use": "imported",
  "robot": "/image/resize",
  "result": true,
  "height": 130,
  "imagemagick_stack": "v2.0.7",
  "width": 130,
  "zoom": false
})
assembly.AddStep("exported", map[string]interface{}{
  "use": ["imported", "resized"],
  "robot": "/s3/store",
  "credentials": "YOUR_AWS_CREDENTIALS",
  "path": "my_resized/",
  "url_prefix": "https://demos.transloadit.com/"
})

// These Instructions do not require uploads, otherwise:
// assembly.AddFile("myfile_1", "./lolcat.jpg")

// Start the Assembly
info, err := client.StartAssembly(context.Background(), assembly)
if err != nil {
  panic(err)
}

// All files have now been uploaded and the Assembly has started but no
// results are available yet since the conversion has not finished.
// WaitForAssembly provides functionality for polling until the Assembly
// has ended.
info, err = client.WaitForAssembly(context.Background(), info)
if err != nil {
  panic(err)
}

fmt.Printf("You can check some results at: \n")
fmt.Printf("  - %s\n", info.Results["imported"][0].SSLURL)
fmt.Printf("  - %s\n", info.Results["resized"][0].SSLURL)
fmt.Printf("  - %s\n", info.Results["exported"][0].SSLURL)

Read docs: Go SDK

// compile 'com.transloadit.sdk:transloadit:0.1.5'
import com.transloadit.sdk.Assembly;
import com.transloadit.sdk.Transloadit;
import com.transloadit.sdk.exceptions.LocalOperationException;
import com.transloadit.sdk.exceptions.RequestException;
import com.transloadit.sdk.response.AssemblyResponse;

import java.io.File;
import java.util.HashMap;
import java.util.Map;

public class Main {
  public static void main(String[] args) {
    Transloadit transloadit = new Transloadit("YOUR_TRANSLOADIT_KEY", "YOUR_TRANSLOADIT_SECRET");
    Assembly assembly = transloadit.newAssembly();
    // Set Encoding Instructions

    Map<String Object> importedStepOptions = new HashMap();
    importedStepOptions.put("result", true);
    importedStepOptions.put("credentials", "YOUR_AWS_CREDENTIALS");
    importedStepOptions.put("path", "my_folder/");
    assembly.addStep("imported", "/s3/import", importedStepOptions);
      

    Map<String Object> resizedStepOptions = new HashMap();
    resizedStepOptions.put("use", "imported");
    resizedStepOptions.put("result", true);
    resizedStepOptions.put("height", 130);
    resizedStepOptions.put("imagemagick_stack", "v2.0.7");
    resizedStepOptions.put("width", 130);
    resizedStepOptions.put("zoom", false);
    assembly.addStep("resized", "/image/resize", resizedStepOptions);
      

    Map<String Object> exportedStepOptions = new HashMap();
    exportedStepOptions.put("use", new String[]{"imported", "resized"});
    exportedStepOptions.put("credentials", "YOUR_AWS_CREDENTIALS");
    exportedStepOptions.put("path", "my_resized/");
    exportedStepOptions.put("url_prefix", "https://demos.transloadit.com/");
    assembly.addStep("exported", "/s3/store", exportedStepOptions);
      

    // These Instructions do not require uploads, otherwise:
    // assembly.addFile(new File("./lolcat.jpg"));

    // Start the Assembly
    try {
      AssemblyResponse response = assembly.save();
      
      // Wait for Assembly to finish executing
      while (!response.isFinished()) {
        response = transloadit.getAssemblyByUrl(response.getSslUrl());
      }
      
      System.out.println(response.getId());
      System.out.println(response.getUrl());
      System.out.println(response.json());
    } catch (RequestException | LocalOperationException e) {
      // Handle exception here
    }
  }
}

Read docs: Java SDK

So many ways to integrate

Transloadit is a service for companies with developers. As a developer, there are many ways you can put us to good use.

Bulk imports

Add one of our import Robots to acquire and transcode massive media libraries.
Handling uploads

We are the experts at reliably handling uploads. We wrote the protocol for it.
Front-end integration

We integrate with web browsers via our next-gen file uploader Uppy and SDKs for Android and iOS.
Back-end integration

Send us batch jobs in any server language using one of our SDKs or directly interfacing with our REST API.
Pingbacks

Configure a notify_url to let your server receive transcoding results JSON in the transloadit POST field.

Get started for free

Free plan with 5 GB encoding credit
Set monthly spending limits
Try without a credit card
Highly available, globally distributed platform
Cancel at any time
Costs displayed for each upload/conversion

Sign up via GitHub or Sign up with email

Try it in your account

Copy these instructions to a Template of your own
(you'll be able to make changes before actually saving)

Copy to Template

Need help? Talk to a human

We are a Swiss Army knife for your files

Import an entire folder of files from S3

1. Import files from Amazon S3

2. Resize images to 130×130

3. Export files to Amazon S3

Live Demo. See for yourself

Build this in your own language

So many ways to integrate

Bulk imports

Handling uploads

Front-end integration

Back-end integration

Pingbacks

Follow us on Twitter:

Star Uppy on GitHub:

What’s happening on Twitter

Try it in your account

Other cool demos

We are a Swiss Army knife for your files

Import an entire folder of files from S3

1. Import files from Amazon S3

2. Resize images to 130×130

3. Export files to Amazon S3

Live Demo. See for yourself

Build this in your own language

So many ways to integrate

Bulk imports

Handling uploads

Front-end integration

Back-end integration

Pingbacks

Share your Transloadit project to earn $300

Get started for free

Follow us on Twitter:

Join 20k+ developers

Get started today

Star Uppy on GitHub:

What’s happening on Twitter

Try it in your account

Other cool demos