Business, tech, and life by a nerd. New every Tuesday: Splitting Light: The Prism of Growth and Discovery.
Share
Splitting Light: Season 3 - Episode 07
Published about 2 months ago • 3 min read
Splitting light
Season 3 Episode 07
A second world first
If you are no longer interested in the newsletter, please unsubscribe
July 2019 to February 2020
In February 2020, we, the storage team at Scaleway, were released a world first. Personally, it was my second, the first one being the bare metal arm cloud back in 2014.
Image from the blog post on the feature (1)
We released “the first non-AWS S3 compatible GLACIER storage class”. This was a year after the first region in General Availability in Amsterdam. Nine months after the Paris region in General Availability.
The wording had been carefully chosen. I remember pushing back on the initial marketing release draft. I pushed back because I felt it was not accurate. When this phrasing came back from marketing, we were all surprised. We checked. Lo and behold, it was true. We were the first non AWS cloud provider to release S3 compatible GLACIER storage class.
Image from the release tweet (2)
The release of the feature was done in two phases. First we had released the lifecycle policy and engine a few months earlier, in June 2019. The work for this had been done by Nicolas (a).
The GLACIER storage class had been testable internally since early summer 2019. But we didn’t want to release it to GA until we had the customer console implementation. Anyhow, it was a bad idea to release it during the french summer holidays. I spent some time digging up how the AWS did their UI and did several meetings with the UX/UI people at Scaleway to advance that track. We used the summer to hammer out the bugs in the backend implementation. Louis (b) did that with some heavy testing and edge case testing to eliminate the last issues. By September 2019, the storage side was ready, we had to wait for the rest to catch up. We didn’t want to trigger lightning again.
The release of the GLACIER storage class was successful. It was so successful that Nicolas quickly had to do a second version of the lifecycle engine. Moving from a single program to a fully distributed program that was able to follow the customer usage curve.
GLACIER Storage class is in a nuclear proof bunker under Paris (3)
This episode taught me a lesson. Marketing is important. I think as engineers we can sometimes roll our eyes at the marking fluff. At least I do. But I believe that you can do accurate marketing. Understanding what the customer wants, understanding the constraints, the markets and finally boiling down to first principles is paramount. Only then does the distillation make good marketing. But to do this, you have to overcome the initial distaste. You have to put yourself in the shoes of the marketing team. Understand the desired outcome. Find ways to make it work. Find how to collaborate. The same lesson applies to every department. I would learn that later on.
Find something that you do differently and talk about why it matters to the customers or the rest of the ecosystem. That is a good start.
As Scaleway was gearing up for the general availability of the GLACIER storage class, we had a lot of production to handle. The team was stretched. To handle the load we needed to recruit new people in the storage team.
Splitting light Season 3 Episode 13 Bills reconciliation If you are no longer interested in the newsletter, please unsubscribe January to March 2019 When you have a complex system there are always going to be discrepancies between them. In our case the discrepancies were in the billing systems. We had five different data sources. None agreed on the numbers. Let me introduce our five systems. Observability of the disk usage as well as the incoming and outgoing bandwidth. The client...
Splitting light Season 3 Episode 12 Warsaw If you are no longer interested in the newsletter, please unsubscribe End of January 2020 to beginning of February 2020. In January 2020, we had a new challenge. A new opponent to ring in and control. Let me introduce him. It was the Warsaw region! We had to deploy object storage in Warsaw. Back in September 2019 we had selected the hardware setup and had done a brief discovery of it. Then the whole region’s hardware had been shipped by truck. Once...
Splitting light Season 3 Episode 11 OpenIO reaching out If you are no longer interested in the newsletter, please unsubscribe End of 2019 While we were dealing with the 500k object problem in object storage, Jean-Francois Smigielski (a), OpenIO’s CTO reached out to me on their community Slack. They were looking to hire more engineers and several people that they trusted had told them I was what they needed. Most likely I had also done a good impression when we had worked together to bootstrap...