February 2017

No incidents reported for this month.

January 2017

Impaired database performance
This incident has been resolved.
Jan 4, 20:02-20:29 UTC
Impaired database performance
Performance remains normal. Postmortem will follow.
Jan 4, 13:11-16:11 UTC

December 2016

Impaired database performance
This incident has been resolved.
Dec 19, 17:53-21:04 UTC
[Scheduled] Sunday 18 December: Scheduled downtime to perform database maintenance
The scheduled maintenance has been completed.
Dec 18, 08:22-10:00 UTC
Outage
This incident has been resolved.
Dec 15, 14:13-15:25 UTC
Impaired website performance
This incident has been resolved.
Dec 15, 10:52-11:22 UTC

November 2016

Impaired website performance
This incident has been resolved.
Nov 30, 14:41-16:44 UTC
Loss of capacity on web
This incident has been resolved.
Nov 23, 10:33-15:00 UTC
Impaired upload performance
Due to a slowdown in a tracing system we are using file processing requests have slowed down. We have disabled the tracing system and the performance has returned to normal levels.
Nov 4, 12:30-12:48 UTC
Impaired website performance
Performance has restored to normal levels, the website is again available
Nov 3, 16:03-17:06 UTC

October 2016

Impaired upload processing
The backlog of processing updates has cleared up, we are up and running.
Oct 27, 09:06-18:16 UTC
Loss of capacity on the web application
We will share a post mortem when we have all details straight.
Oct 21, 16:39-17:49 UTC

September 2016

Short outage
This morning we experienced an outage of the website lasting several minutes. The problem was caused by a misbehaving cache cluster, which ran out of memory. Our engineers quickly investigated and solved the problem to get the service back up. We are following up with planned maintenance to ensure this problem does not reoccur in the future. Apologies for the interruption, and happy transferring!
Sep 21, 09:05 UTC

August 2016

Email processing affected
By the looks of it, Sendgrid has taken care of the problem entirely: http://status.sendgrid.com/
Aug 25, 17:05-17:44 UTC
Delay in processing EU uploads
We have implemented a fix, the processing pipeline is healthy again. A post-mortem will follow.
Aug 19, 06:55-09:39 UTC

July 2016

Loss of capacity on the API servers
This last attempt was successful, finally. Everything completed in time and the service didn't suffer meanwhile. Our main database is now redundant again. We just ran and re-enabled all the scheduled tasks (for cleaning up expired transfers, sending out mails, etc) that didn't ran during the last few hours. From now on, back to normal. Thank you all for your patience and understanding. Now, happy Monday morning transferring!
Jul 10, 09:35 - Jul 11, 05:19 UTC
[Scheduled] Database maintenance
The scheduled maintenance has been completed.
Jul 10, 07:42-07:55 UTC
Loss of capacity on the upload/download API
At 12:00 PM PDT the system has recovered fully. Thank you to all our users for your patience.
Jul 7, 12:46-19:04 UTC
Processing of US uploads is delayed
At 12:30 PM PDT the last entries from the queue had been processed, which means every transfer should have reached its destination by now. Thank you for your patience.
Jul 5, 14:58-19:45 UTC
Delay in processing EU uploads
Some parts of EU processing were not performing optimally, creating a slowdown for uploads in the EU. We replaced the underperforming parts and are back in business. All uploads are being processed optimally again.
Jul 5, 10:19-10:42 UTC

June 2016

Loss of capacity on the upload/download API
The system has recovered, some transfers in flight might be delayed in processing by a few minutes.
Jun 29, 14:37-14:44 UTC
Failing uploads in EU
We have identified the issue. After some work we managed to process all the hung uploads and we ensured that the uploads will process normally.
Jun 21, 14:01-15:23 UTC

May 2016

Upload processing delayed for EU servers
An upload manager with a faulty disk crippled the service the past couple of hours. We're in the process of getting rid of the resulting backlog, which should be taking care of in an estimated three hours. All new uploads are processed promptly.
May 8, 12:09-14:30 UTC
Hiccups with download handling and upload processing
All transfers that were stuck have been processed now.
May 2, 13:39-14:39 UTC

April 2016

Major capacity loss on the web servers
The issue has been resolved, we are going to place a post-mortem explanation.
Apr 29, 10:08-12:25 UTC
Hiccup in transfer processing
Due to provisioning problems, new api instances weren't created properly, leading to an under-capacity from around 16:00. This under-capacity resulted in a backlog of processing transfers. When we resolved this issue, a 2nd backlog was created for pending emails. The database handling this backlog could not cope, and was replaced by a beefier one, causing a delay in the sending of these email. After the database was replaced the backlog finally resolved itself at 2am on April 7th.
Apr 6

March 2016

Cascading download server failures
Due to a bug in our download server code, some download servers had their disks fill up with stale data. This caused a capacity loss on the downloads and some users could receive error messages when attempting a download.
Mar 2

February 2016

No incidents reported for this month.

January 2016

Sendgrid failure
Sendgrid (our email provider) are experiencing some issues with mail delivery. Some transfer notifications can be delayed. We expect the problem to be resolved soon.
Jan 25
Scheduled website maintenance
We will be performing a scheduled maintenance on our web systems, and expect to be back soon.
Jan 16

December 2015

Downloads flagged as unsafe by Google
When switching to a new download infrastructure, Google started flagging our download domain as unsafe. Google Chrome users could experience the red screen showing that the download is unsafe. We are working on resolving the situation with Google.
Dec 4

November 2015

No incidents reported for this month.

October 2015

No incidents reported for this month.

September 2015

No incidents reported for this month.

August 2015

No incidents reported for this month.

July 2015

Primary database failover
We have experienced a failure of our primary database. The proper switchover to the fallback database system took place as required and incurred about 10 minutes of downtime.
Jul 16
Scheduled datbaase maintenance
We will be performing a scheduled maintenance on our main database, the website is going to be offline for a few hours.
Jul 15

June 2015

No incidents reported for this month.

May 2015

Crash of the main database instance
A manual backup process worked overnight to re-establish multiple live copies of the affected data. This morning we triggered another one of those backup processes. Unfortunately, the Monday morning traffic flow proved too much to handle both the backup and live traffic, and stopping this backup was not an option as it is required in the process of re-establish multiple live copies. This is why we decided to manually pull the site down until this process had finished.
May 18

April 2015

No incidents reported for this month.

March 2015

Scheduled datbaase maintenance
We will be performing a scheduled maintenance on our main database, the website is going to be offline for a few hours.
Mar 20

February 2015

Mo money mo problems
Looks like someone forgot to close the WeTransfer investment vault after swimming in cash or doing the money dance, and now the site is down because our servers are being smothering by piles of money. Sorry!
Feb 20