#post-mortem

Here are our posts tagged post-mortem:

• Mitigating Redis connection exhaustion in us-east incident

  On September 3, 2025 (US‑East), we experienced elevated queue times and, in periods, stalled job processing due to Redis connection exhaustion. The issue was stabilized the same da...
  Kevin van Zonneveld  ·  September 3, 2025

• Switching our CA to Let's Encrypt (and possible breakage)

  We are writing to address a recent issue that has arisen as a result of our change in SSL certificates from GoDaddy to Let's Encrypt. A small number of our customers have reported...
  Kevin van Zonneveld  ·  July 6, 2023

• Quick fix for API vulnerability ensures data security

  We regret to inform you that a vulnerability was identified in one of our API services, specifically related to the functionality that generates a thumbnail of a user-specified web...
  Kevin van Zonneveld  ·  June 28, 2023

• Enhanced security: fixing ImageMagick vulnerability

  On Thursday June 20, 2019, our support captain raised a red alert when a vulnerability was reported that a Transloadit server could be rooted. This is the maximum amount of privile...
  Kevin van Zonneveld  ·  July 30, 2019

• Addressing the December 6 outage: steps & solutions

  On December 6, the thing we always dread the most happened. At 13:23, we noticed capacity issues with our platform. It soon turned out to be a serious issue which resulted in downt...
  Kevin van Zonneveld  ·  December 19, 2018

• Addressing the Ghostscript security flaw at Transloadit

  On August 21, 2018, Tavis Ormandy of Google's Project Zero disclosed security issues with the way that ImageMagick delegates work to Ghostscript.
  Kevin van Zonneveld  ·  August 30, 2018

• Accidental breaking change for the crop resize strategy

  On 4 June at 5:32pm CEST, we deployed a backward-compatibility-breaking change, even though we pledge to never 'just do' this and, for example, take extreme care in stack herding t...
  Kevin van Zonneveld  ·  June 6, 2018

• We found and fixed a bug in our data usage calculation

  We recently encountered a bug in our data usage calculation which has affected the invoices of 25% of our customers for the month of June. As a result of this bug, between June 15...
  Tim Koschützki  ·  July 9, 2017

• Addressing Redis issues to enhance stability and speed

  Sometimes, things go wrong at Transloadit. When that happens, we want to be transparent about it and own up to our mistakes. In that light, I'm disclosing an issue that affected 81...
  Kevin van Zonneveld  ·  May 30, 2016

• Transloadit's response to ImageTragick vulnerability

  Early this morning, word came out about a critical bug in ImageMagick, which was quickly nicknamed ImageTragick. Transloadit is a sponsor and long time user of ImageMagick, so it i...
  Kevin van Zonneveld  ·  May 4, 2016

• Apology for Rate Limiter outage & fixes implemented

  Yesterday at 10:49 a.m., we had an issue that affected 2.7% of our customers.
  Tim Koschützki  ·  November 27, 2015

• Apology for missed support requests due to spam filter

  We are writing this to let you know that something went terribly wrong at Transloadit.
  Kevin van Zonneveld  ·  September 25, 2015

• Addressing the S3 incident with fixes and discounts

  Yesterday afternoon, we unfortunately had an incident that lasted for approximately 90 minutes. This incident was caused by a bug that we placed into the system ourselves.
  Tim Koschützki  ·  February 17, 2015

• Enhancing jQuery SDK with tests and a critical patch

  Unfortunately, we've been having a few problems with our jQuery SDK these past two days. We are very sorry about that and sadly, we don't really have a better explanation to give o...
  Tim Koschützki  ·  October 23, 2014

• Addressing elevated queue times & ensuring reliability

  Last night we experienced an outage that we promised to shed some more light on. At 22.35 CET it came to our attention that we had elevated queue times.
  Kevin van Zonneveld  ·  March 31, 2012

• Addressing S3 put request inconsistencies at Transloadit

  Amazon S3 is great. Except when it isn't. When you are using it a lot - we have stored around one million customer objects so far - you begin to see some odd things that look more...
  Felix Geisendörfer  ·  May 16, 2011