Splitting Light: Season 3 - Episode 07


Splitting light

Season 3 Episode 07

A second world first

If you are no longer interested in the newsletter, please unsubscribe

July 2019 to February 2020

In February 2020, we, the storage team at Scaleway, were released a world first. Personally, it was my second, the first one being the bare metal arm cloud back in 2014.

We released “the first non-AWS S3 compatible GLACIER storage class”. This was a year after the first region in General Availability in Amsterdam. Nine months after the Paris region in General Availability.


The wording had been carefully chosen. I remember pushing back on the initial marketing release draft. I pushed back because I felt it was not accurate. When this phrasing came back from marketing, we were all surprised. We checked. Lo and behold, it was true. We were the first non AWS cloud provider to release S3 compatible GLACIER storage class.

The release of the feature was done in two phases. First we had released the lifecycle policy and engine a few months earlier, in June 2019. The work for this had been done by Nicolas (a).

The GLACIER storage class had been testable internally since early summer 2019. But we didn’t want to release it to GA until we had the customer console implementation. Anyhow, it was a bad idea to release it during the french summer holidays.

I spent some time digging up how the AWS did their UI and did several meetings with the UX/UI people at Scaleway to advance that track. We used the summer to hammer out the bugs in the backend implementation. Louis (b) did that with some heavy testing and edge case testing to eliminate the last issues. By September 2019, the storage side was ready, we had to wait for the rest to catch up. We didn’t want to trigger lightning again.

The release of the GLACIER storage class was successful. It was so successful that Nicolas quickly had to do a second version of the lifecycle engine. Moving from a single program to a fully distributed program that was able to follow the customer usage curve.

This episode taught me a lesson. Marketing is important. I think as engineers we can sometimes roll our eyes at the marking fluff. At least I do. But I believe that you can do accurate marketing. Understanding what the customer wants, understanding the constraints, the markets and finally boiling down to first principles is paramount. Only then does the distillation make good marketing. But to do this, you have to overcome the initial distaste. You have to put yourself in the shoes of the marketing team. Understand the desired outcome. Find ways to make it work. Find how to collaborate. The same lesson applies to every department. I would learn that later on.

Find something that you do differently and talk about why it matters to the customers or the rest of the ecosystem. That is a good start.

As Scaleway was gearing up for the general availability of the GLACIER storage class, we had a lot of production to handle. The team was stretched. To handle the load we needed to recruit new people in the storage team.

  1. You can find a blog post on Scaleway’s website that goes into details: https://www.scaleway.com/en/blog/behind-the-scenes-c14-cold-storage/
  2. https://x.com/Scaleway/status/1232957928614899713
  3. https://x.com/Scaleway/status/1377290895226241025

(a) Nicolas Sampré, Storage DevOps at the time, now Staff backend engineer at Qonto

(b) Louis Solofrizzo, Storage DevOps at the time, still at Scaleway

If you have missed it, you can read the previous episode here

To pair with :

  • Gargarin - Public service broadcast, Psychemagik remix
  • EBADE

Vincent Auclair

Connect with me on your favorite network!

Payson, Payson, AZ 85541
Unsubscribe · Preferences

Symbol Sled

Business, tech, and life by a nerd. New every Tuesday: Splitting Light: The Prism of Growth and Discovery.

Read more from Symbol Sled

Splitting light Season 3 Episode 13 Bills reconciliation If you are no longer interested in the newsletter, please unsubscribe January to March 2019 When you have a complex system there are always going to be discrepancies between them. In our case the discrepancies were in the billing systems. We had five different data sources. None agreed on the numbers. Let me introduce our five systems. Observability of the disk usage as well as the incoming and outgoing bandwidth. The client...

Splitting light Season 3 Episode 12 Warsaw If you are no longer interested in the newsletter, please unsubscribe End of January 2020 to beginning of February 2020. In January 2020, we had a new challenge. A new opponent to ring in and control. Let me introduce him. It was the Warsaw region! We had to deploy object storage in Warsaw. Back in September 2019 we had selected the hardware setup and had done a brief discovery of it. Then the whole region’s hardware had been shipped by truck. Once...

Splitting light Season 3 Episode 11 OpenIO reaching out If you are no longer interested in the newsletter, please unsubscribe End of 2019 While we were dealing with the 500k object problem in object storage, Jean-Francois Smigielski (a), OpenIO’s CTO reached out to me on their community Slack. They were looking to hire more engineers and several people that they trusted had told them I was what they needed. Most likely I had also done a good impression when we had worked together to bootstrap...