We're excited to announce that Transloadit has joined the growing movement to make the web more AI-friendly by implementing support for /llms.txt and /llms-full.txt files. This addition makes our extensive documentation and API capabilities more accessible to large language models (LLMs), enabling developers to build more powerful AI-integrated applications with Transloadit.

What is llms.txt?

Proposed by Jeremy Howard, co-founder of Answer.AI, in September 2024, the /llms.txt standard addresses a critical challenge facing AI systems: hallucinations and context window limitations. It provides structured, concise information specifically formatted for LLMs.

Similar to how robots.txt helps search engines navigate websites, llms.txt guides LLMs. It eliminates the need for AI to parse complex HTML, JavaScript, and other web elements, which consume valuable context window space. These files offer a high signal-to-noise ratio, helping LLMs produce better results without relying on compressed, potentially outdated information.

The standard consists of two main components:

  • /llms.txt: A concise overview with structured links to key resources.
  • /llms-full.txt: A comprehensive version containing detailed documentation in markdown format.

Why this matters for developers

Transloadit's implementation of llms.txt offers significant benefits for developers working with AI tools:

  1. Improved AI Understanding: AI assistants can now better understand Transloadit's capabilities. This makes it easier to generate accurate code examples and explanations when building integrations.

  2. Efficient Context Usage: The streamlined format allows you to include Transloadit documentation in your AI prompts without wasting valuable context tokens.

  3. More Accurate Responses: AI tools can access up-to-date information about our Robots, parameters, and workflows, reducing errors in generated code.

  4. Enhanced Developer Experience: When using AI coding assistants like GitHub Copilot or Cursor, you'll receive more precise guidance on implementing Transloadit's file processing capabilities.

What's included in our implementation

Our /llms.txt file provides a concise overview of Transloadit's core functionality, including:

  • A clear explanation of our file uploading and processing capabilities.
  • Example Assembly Instructions demonstrating our JSON-based workflow configuration.
  • Links to key documentation resources.
  • A comprehensive list of available Robots.

The more detailed /llms-full.txt expands on this with:

  • Detailed Robot parameter schemas.
  • Code examples for various integration scenarios.
  • Comprehensive documentation on all aspects of the Transloadit service.

How to use llms.txt with AI tools

When working with AI assistants like ChatGPT, Claude, or GitHub Copilot, you can now reference our llms.txt files to provide better context:

  1. Direct URL Reference: Point the AI to https://transloadit.com/llms.txt or https://transloadit.com/llms-full.txt. In Cursor, you can mention the URL with @https://transloadit.com/llms-full.txt.
  2. Content Inclusion: Copy the content directly into your prompts for local AI processing.
  3. File Upload: Download the files and upload them to AI tools that support file attachments.
  4. Agentic Inclusions: AI agents may automatically detect the existence of llms.txt on a domain and include it when needed.

Join the ai-friendly web movement

The llms.txt standard represents an important step toward making web content more accessible to AI systems. As more services implement this standard, developers will benefit from improved AI assistance across their entire technology stack.

We encourage other services to join this movement and implement their own llms.txt files. For more information about the standard, visit llmstxt.org.

Resources

We're excited to see how developers will use this new capability to build even more powerful applications with Transloadit. As always, we welcome your feedback and questions in our Community Forum.