Import an entire folder of files from S3

Our /s3/import Robot allows you to import entire folders of files from your Amazon S3 account with very easy syntax. After the processing is done, you can see which files were imported in the result JSON at the bottom.

Warning It seems your browser does not send the referer, which we need to stop people from (ab)using our demos in other websites. If you want to use the demos, please allow your browser to send its referer to us. Adding us to the whitelist of blockers usually helps.

1. Import files from Amazon S3

We are happy to import from whatever storage solution suits you best. Learn more ›

Warning It seems your browser does not support the codec used in this video of the demo. For demo simplicity we'll link you to the original file, but you may also want to learn how to make videos compatible for all browsers.

snowflake-0.jpg

134 KB · 1152 × 768

desert-1.jpg

1.6 MB · 2560 × 2048

ravi-roshan-383162-2.jpg

1.5 MB · 4096 × 2301

"imported": {
  "robot": "/s3/import",
  "result": true,
  "credentials": "demo_s3_credentials",
  "path": "my_folder/"
}

/s3/import Robot

This bot imports whole directories of files from your S3 bucket

2. Resize images to 130×130

We can resize, crop, and (auto-)rotate images, as well as watermark them. Learn more ›

Warning It seems your browser does not support the codec used in this video of the demo. For demo simplicity we'll link you to the original file, but you may also want to learn how to make videos compatible for all browsers.

snowflake-0.jpg

33 KB · 130 × 87

desert-1.jpg

5.5 KB · 130 × 104

ravi-roshan-383162-2.jpg

5.5 KB · 130 × 73

"resized": {
  "robot": "/image/resize",
  "use": "imported",
  "result": true,
  "zoom": false,
  "width": 130,
  "height": 130,
  "imagemagick_stack": "v2.0.3"
}

/image/resize Robot

This bot resizes, crops, changes colorization, rotation, and applies text and watermarks to images

3. Export files to Amazon S3

We export to the storage platform of your choice. Learn more ›

imported

resized

Once files are exported, we ping you back with the Assembly status JSON.

"exported": {
  "use": [
    "imported",
    "resized"
  ],
  "robot": "/s3/store",
  "path": "my_resized/",
  "credentials": "demo_s3_credentials"
}

/s3/store Robot

This bot exports encoding results to Amazon S3

Since this is a store Robot, be sure to use Template Credentials so that any sensitive data is encrypted and stored in our database, making sure that they’re never exposed to any end-user.

Try it yourself

Full code used

{
  "imported": {
    "robot": "/s3/import",
    "result": true,
    "credentials": "demo_s3_credentials",
    "path": "my_folder/"
  },
  "resized": {
    "robot": "/image/resize",
    "use": "imported",
    "result": true,
    "zoom": false,
    "width": 130,
    "height": 130,
    "imagemagick_stack": "v2.0.3"
  },
  "exported": {
    "use": [
      "imported",
      "resized"
    ],
    "robot": "/s3/store",
    "path": "my_resized/",
    "credentials": "demo_s3_credentials"
  }
}

// Add 'Transloadit' to your Podfile, run 'pod install', add credentials to 'Info.plist'
import Arcane
import TransloaditKit

// Add instructions, e.g. resize image, or encode video
var AssemblySteps: Array = Array<Step>() // An array to hold the Steps

var Step1 = Step (key: "imported") // Create a Step object
Step1?.setValue("/s3/import", forOption: "robot") // Add the details
Step1?.setValue(true, forOption: "result") // Add the details
Step1?.setValue("demo_s3_credentials", forOption: "credentials") // Add the details
Step1?.setValue("my_folder/", forOption: "path") // Add the details
AssemblySteps.append(Step1) // Add the Step to the array

var Step2 = Step (key: "resized") // Create a Step object
Step2?.setValue("imported", forOption: "use") // Add the details
Step2?.setValue("/image/resize", forOption: "robot") // Add the details
Step2?.setValue(true, forOption: "result") // Add the details
Step2?.setValue(130, forOption: "height") // Add the details
Step2?.setValue("v2.0.3", forOption: "imagemagick_stack") // Add the details
Step2?.setValue(130, forOption: "width") // Add the details
Step2?.setValue(false, forOption: "zoom") // Add the details
AssemblySteps.append(Step2) // Add the Step to the array

var Step3 = Step (key: "exported") // Create a Step object
Step3?.setValue(["imported","resized"], forOption: "use") // Add the details
Step3?.setValue("/s3/store", forOption: "robot") // Add the details
Step3?.setValue("demo_s3_credentials", forOption: "credentials") // Add the details
Step3?.setValue("my_resized/", forOption: "path") // Add the details
AssemblySteps.append(Step3) // Add the Step to the array

// We then create an Assembly Object with the Steps and files
var MyAssembly: Assembly = Assembly(steps: AssemblySteps, andNumberOfFiles: 1)

// Add files to upload

// Start the Assembly
Transloadit.createAssembly(MyAssembly) 

// Fires after your Assembly has completed
transloadit.assemblyStatusBlock = {(_ completionDictionary: [AnyHashable: Any]) -> Void in
  print("\(completionDictionary.description)")
}

<body>
  <form action="/uploads" enctype="multipart/form-data" method="POST">
    <input type="file" name="my_file" multiple="multiple" />
  </form>

  <script src="//ajax.googleapis.com/ajax/libs/jquery/3.2.0/jquery.min.js"></script>
  <script src="//assets.transloadit.com/js/jquery.transloadit2-v3-latest.js"></script>
  <script type="text/javascript">
  $(function() {
    $('form').transloadit({
      wait: true,
      triggerUploadOnFileSelection: true,
      params: {
        auth: {
          // To avoid tampering use signatures:
          // https://transloadit.com/docs/api/#authentication
          key: 'YOUR_TRANSLOADIT_KEY',
        },
        // It's often better store encoding instructions in your account
        // and use a `template_id` instead of adding these steps inline
        steps: {
          imported: {
            robot: '/s3/import',
            result: true,
            credentials: 'demo_s3_credentials',
            path: 'my_folder/'
          },
          resized: {
            use: 'imported',
            robot: '/image/resize',
            result: true,
            height: 130,
            imagemagick_stack: 'v2.0.3',
            width: 130,
            zoom: false
          },
          exported: {
            use: ['imported','resized'],
            robot: '/s3/store',
            credentials: 'demo_s3_credentials',
            path: 'my_resized/'
          }
        }
      }
    });
  });
  </script>
</body>

<link href="https://transloadit.edgly.net/releases/uppy/v1.0.0/uppy.min.css" rel="stylesheet">
<script src="https://transloadit.edgly.net/releases/uppy/v1.0.0/uppy.min.js"></script>

<button id="uppy-open-modal">Select Files</button>
<script>
  const uppy = Uppy.Core({ debug: true, autoProceed: false })
    .use(Uppy.Transloadit, {
      params: {
        auth: {
          // To avoid tampering use signatures:
          // https://transloadit.com/docs/api/#authentication
          key: 'YOUR_TRANSLOADIT_KEY'
        },
        // It's often better store encoding instructions in your account
        // and use a `template_id` instead of adding these steps inline
        steps: {
          imported: {
            'robot': '/s3/import',
            'result': true,
            'credentials': 'demo_s3_credentials',
            'path': 'my_folder/'
          },
          resized: {
            'use': 'imported',
            'robot': '/image/resize',
            'result': true,
            'height': 130,
            'imagemagick_stack': 'v2.0.3',
            'width': 130,
            'zoom': false
          },
          exported: {
            'use': ['imported','resized'],
            'robot': '/s3/store',
            'credentials': 'demo_s3_credentials',
            'path': 'my_resized/'
          }
        }
      },
      waitForEncoding: true
    })
    .use(Uppy.Dashboard, {
      trigger: '#uppy-open-modal',
      target: 'body'
    })
    .use(Uppy.Webcam, { target: Uppy.Dashboard })
    .use(Uppy.Instagram, {
      target: Uppy.Dashboard,
      companionUrl: 'https://api2.transloadit.com/companion',
      companionAllowedHosts: '.transloadit.com$'
    })
    .use(Uppy.Url, {
      target: Uppy.Dashboard,
      companionUrl: 'https://api2.transloadit.com/companion',
      companionAllowedHosts: '.transloadit.com$'
    })
    .on('transloadit:result', (stepName, result) => {
      // use transloadit encoding result here.
      console.log('Result here ====>', stepName, result)
    })
</script>

// npm install transloadit --save
const TransloaditClient = require('transloadit')

const transloadit = new TransloaditClient({
  authKey: 'YOUR_TRANSLOADIT_KEY',
  authSecret: 'YOUR_TRANSLOADIT_SECRET'
})


const options = {
  params: {
    steps: {
      imported: {
        robot: '/s3/import',
        result: true,
        credentials: 'demo_s3_credentials',
        path: 'my_folder/',
      },
      resized: {
        use: 'imported',
        robot: '/image/resize',
        result: true,
        height: 130,
        imagemagick_stack: 'v2.0.3',
        width: 130,
        zoom: false,
      },
      exported: {
        use: ['imported','resized'],
        robot: '/s3/store',
        credentials: 'demo_s3_credentials',
        path: 'my_resized/',
      },
    }
  }
}

transloadit.createAssembly(options, (err, result) => {
  if (err) {
    throw err
  }

  console.log({result})
})

npm install transloadify -g

export TRANSLOADIT_KEY="YOUR_TRANSLOADIT_KEY"
export TRANSLOADIT_SECRET="YOUR_TRANSLOADIT_SECRET"

echo '{
  "imported": {
    "robot": "/s3/import",
    "result": true,
    "credentials": "demo_s3_credentials",
    "path": "my_folder/"
  },
  "resized": {
    "robot": "/image/resize",
    "use": "imported",
    "result": true,
    "zoom": false,
    "width": 130,
    "height": 130,
    "imagemagick_stack": "v2.0.3"
  },
  "exported": {
    "use": [
      "imported",
      "resized"
    ],
    "robot": "/s3/store",
    "path": "my_resized/",
    "credentials": "demo_s3_credentials"
  }
}' > ./steps.json

transloadify \
  --input ./lolcat.jpg \
  --output ./resized-lolcat.jpg \
  --steps ./steps.json

// Install "transloadit/php-sdk"
// via Composer (https://getcomposer.org)
use transloadit\Transloadit;
$transloadit = new Transloadit([
  "key" => "YOUR_TRANSLOADIT_KEY",
  "secret" => "YOUR_TRANSLOADIT_SECRET",
]);

$files = [];

$response = $transloadit->createAssembly([
  "files" => $files, 
  "params" => [
    "steps" => [
      "imported" => [
        "robot" => "/s3/import",
        "result" => true,
        "credentials" => "demo_s3_credentials",
        "path" => "my_folder/",
      ],
      "resized" => [
        "use" => "imported",
        "robot" => "/image/resize",
        "result" => true,
        "height" => 130,
        "imagemagick_stack" => "v2.0.3",
        "width" => 130,
        "zoom" => false,
      ],
      "exported" => [
        "use" => ["imported", "resized"],
        "robot" => "/s3/store",
        "credentials" => "demo_s3_credentials",
        "path" => "my_resized/",
      ],
    ],
  ],
]);

# gem install transloadit
transloadit = Transloadit.new(
  :key => "YOUR_TRANSLOADIT_KEY",
  :secret => "YOUR_TRANSLOADIT_SECRET"
)

# Add instructions, e.g. resize image, or encode video
imported = transloadit.step "imported", "/s3/import",
  :result => true,
  :credentials => "demo_s3_credentials",
  :path => "my_folder/"
)
resized = transloadit.step "resized", "/image/resize",
  :use => "imported",
  :result => true,
  :height => 130,
  :imagemagick_stack => "v2.0.3",
  :width => 130,
  :zoom => false
)
exported = transloadit.step "exported", "/s3/store",
  :use => ["imported","resized"],
  :credentials => "demo_s3_credentials",
  :path => "my_resized/"
)

assembly = transloadit.assembly(
  :steps => [ imported, resized, exported ]
)

# Add files to upload
files = []

# Start the Assembly
response = assembly.create! *files

until response.finished?
  sleep 1; response.reload!
end

if !response.error?
  # handle success
end

# pip install pytransloadit
from transloadit import client

tl = client.Transloadit('YOUR_TRANSLOADIT_KEY', 'YOUR_TRANSLOADIT_SECRET')
assembly = tl.new_assembly()

# Add instructions, e.g. resize image, or encode video
assembly.add_step('imported', {
  'robot': '/s3/import',
  'result': true,
  'credentials': 'demo_s3_credentials',
  'path': 'my_folder/'
})
assembly.add_step('resized', {
  'use': 'imported',
  'robot': '/image/resize',
  'result': true,
  'height': 130,
  'imagemagick_stack': 'v2.0.3',
  'width': 130,
  'zoom': false
})
assembly.add_step('exported', {
  'use': ['imported','resized'],
  'robot': '/s3/store',
  'credentials': 'demo_s3_credentials',
  'path': 'my_resized/'
})

# Add files to upload

# Start the Assembly
assembly_response = assembly.create(retries=5, wait=True)

print assembly_response.data.get('assembly_id')

# or
print assembly_response.data['assembly_id']

// go get gopkg.in/transloadit/go-sdk.v1
options := transloadit.DefaultConfig
options.AuthKey = "YOUR_TRANSLOADIT_KEY"
options.AuthSecret = "YOUR_TRANSLOADIT_SECRET"
client := transloadit.NewClient(options)

// Initialize new assembly
assembly := transloadit.NewAssembly()

// Add instructions, e.g. resize image, or encode video
assembly.AddStep("imported", map[string]interface{}{
  "robot": "/s3/import",
  "result": true,
  "credentials": "demo_s3_credentials",
  "path": "my_folder/"
})
assembly.AddStep("resized", map[string]interface{}{
  "use": "imported",
  "robot": "/image/resize",
  "result": true,
  "height": 130,
  "imagemagick_stack": "v2.0.3",
  "width": 130,
  "zoom": false
})
assembly.AddStep("exported", map[string]interface{}{
  "use": ["imported","resized"],
  "robot": "/s3/store",
  "credentials": "demo_s3_credentials",
  "path": "my_resized/"
})

// Add files to upload

// Start the Assembly
info, err := client.StartAssembly(context.Background(), assembly)
if err != nil {
  panic(err)
}

// All files have now been uploaded and the Assembly has started but no
// results are available yet since the conversion has not finished.
// WaitForAssembly provides functionality for polling until the Assembly
// has ended.
info, err = client.WaitForAssembly(context.Background(), info)
if err != nil {
  panic(err)
}

fmt.Printf("You can view the result at: %s\n", info.Results["resize"][0].SSLURL)

// compile 'com.transloadit.sdk:transloadit:0.0.3'
import com.transloadit.sdk.Assembly;
import com.transloadit.sdk.Transloadit;
import com.transloadit.sdk.exceptions.LocalOperationException;
import com.transloadit.sdk.exceptions.RequestException;
import com.transloadit.sdk.response.AssemblyResponse;

import java.io.File;
import java.util.HashMap;
import java.util.Map;

public class Main {
    public static void main(String[] args) {
        Transloadit transloadit = new Transloadit("YOUR_TRANSLOADIT_KEY", "YOUR_TRANSLOADIT_SECRET");
        Assembly assembly = transloadit.newAssembly();
        // Add instructions, e.g. resize image, or encode video
        Map<String Object> importedStepOptions = new HashMap();
        importedStepOptions.put("result", true);
        importedStepOptions.put("credentials", "demo_s3_credentials");
        importedStepOptions.put("path", "my_folder/");
        assembly.addStep("imported", "/s3/import", importedStepOptions);
      
        Map<String Object> resizedStepOptions = new HashMap();
        resizedStepOptions.put("use", "imported");
        resizedStepOptions.put("result", true);
        resizedStepOptions.put("height", 130);
        resizedStepOptions.put("imagemagick_stack", "v2.0.3");
        resizedStepOptions.put("width", 130);
        resizedStepOptions.put("zoom", false);
        assembly.addStep("resized", "/image/resize", resizedStepOptions);
      
        Map<String Object> exportedStepOptions = new HashMap();
        exportedStepOptions.put("use", new String[]{"imported", "resized"});
        exportedStepOptions.put("credentials", "demo_s3_credentials");
        exportedStepOptions.put("path", "my_resized/");
        assembly.addStep("exported", "/s3/store", exportedStepOptions);
      
        // Add files to upload
        
        try {
            AssemblyResponse response = assembly.save();

            // wait for assembly to finish executing.
            while (!response.isFinished()) {
                response = transloadit.getAssemblyByUrl(response.getSslUrl());
            }

            System.out.println(response.getId());
            System.out.println(response.getUrl());
            System.out.println(response.json());
        } catch (RequestException | LocalOperationException e) {
            // handle exception here
        }
    }
}

So many ways to integrate

Transloadit is a service for companies with developers. As a developer, there are many ways you can put us to good use.

Bulk imports

Add one of our import Robots to acquire and transcode massive media libraries.
Handling uploads

We are the experts at reliably handling uploads. We wrote the protocol for it.
Front-end integration

We integrate with web browsers via our next-gen file uploader Uppy and SDKs for Android and iOS.
Back-end integration

Send us batch jobs in any server language using one of our SDKs or directly interfacing with our REST API.
Pingbacks

Configure a notify_url to let your server receive transcoding results JSON in the transloadit POST field.

Try it in your account

Copy these instructions to a Template of your own
(you'll be able to make changes before actually saving)

Copy to Template

Get started for free

Free plan with 2 GB encoding credit
Set monthly spending limits
Try without a credit card
Highly available, globally distributed platform
Cancel at any time
Costs displayed for each upload/conversion

Login with GitHub or Sign up with email

Need help? Talk to a human

We are a Swiss Army knife for your files

Import an entire folder of files from S3

1. Import files from Amazon S3

2. Resize images to 130×130

3. Export files to Amazon S3

Try it yourself

Full code used

So many ways to integrate

Bulk imports

Handling uploads

Front-end integration

Back-end integration

Pingbacks

Try it in your account

Get started for free

Other cool demos