Splitting Light: Season 2 - Episode 16


Splitting light

Season 2 Episode 16

Iterative process

If you are no longer interested in the newsletter, please unsubscribe

All throughout these first few months, from December 2017 to May 2018, we did iterations on object storage. This was both necessary to pick the skills and also reduce risks. The work to bring up an object storage is a subset to making a public facing object storage product. In the first case you control everything, in the second, you control much less.

The work was multi dimensional. We had to learn the S3 protocols as well as the client tools. We had to learn how to manage multiple servers in a distributed computing environment. The procurement process, testing components together. The network topology and addressing.

We had to learn what was OpenIO. Configure it, install it and test it. How to authentication and check quotas with the user database. How to bill. Had we gone straight for the final goal without these intermediate steps, it would have been impossible. For each dimension, for each component or step, we quickly tried something then improved. Sometimes, the improvement came much later. It was almost like a skill tree in a game. We unlocked skills as we gained experience points and levels.

The way I see it, each of these components is a dimension. To make the product work, you combine them together. Once combined, mistakes and bugs will cascade and amplify. The larger the number of dimensions, the larger the bug volume is.

Each step required us to do checks. We splitted the work and isolated components to make it possible. During the design phase and after, I made sure that we had no circular dependencies. To make sure we could do a cold start. That we did not depend on a service that depended on S3. If a component broke, I tried to make sure that the blast radius would be as small as possible. More details later on.

A side effect of this methodology was that we had achievements all the time. Every week we accomplished something. It fueled an enormous amount of energy. We stayed late, we worked a lot. It was like a flying wheel and it was going faster and faster. Some of these dimensions we mapped but they were not necessary to do for the beta launch, so we scheduled for later in the roadmap.

Sometimes, however, with an iteration, we had to increase our scope.

(1) Photo by Quentin: https://www.linkedin.com/in/quentinselle/

(2) Taken from a talent calculator on wowhead, https://www.wowhead.com

(3) Photo by Quentin, Ramzy: https://www.linkedin.com/in/ramzib/

If you have missed it, you can read the previous episode here

To pair with :

  • Mbira Spirit - Juj
  • The Hidden Family by Charles Stross

Vincent Auclair

Connect with me on your favorite network!

Oud metha, Dubai, Dubai 00000
Unsubscribe · Preferences

Symbol Sled

Business, tech, and life by a nerd. New every Tuesday: Splitting Light: The Prism of Growth and Discovery.

Read more from Symbol Sled

Splitting light Season 2 Episode 15 Internal identification If you are no longer interested in the newsletter, please unsubscribe End of May 2018 had arrived. I had an appointment. After doing a tattoo on my arm, I continued to look into tattoo art. Looking at different things and identifying more symbolism that I wanted. I remember reading Revenger by Alastair Reynolds, a mix between new space opera and pirates of the caribbean. Spaceships with light sales. I finally contacted the tattoo...

Splitting light Season 2 Episode 14 Access key If you are no longer interested in the newsletter, please unsubscribe We were now at a stage where we had to no longer have hardcoded credentials. We needed to be plugged to Scaleway’s authentication database. Historically Scaleway, the cloud computing division, had decided to design their own API. They used a mechanism called Json Web Token (JWT) to authentify. This system only required a secret credential. On our side, S3 required two things. A...

Splitting light Season 2 Episode 13 Pouring the foundation slab If you are no longer interested in the newsletter, please unsubscribe We had the green light to continue. Now it was time to use these plans and experiments to build a product. We started pouring the foundation slabs. We wrote salt stack deployment code. Reusing the same tool we had used for provisioning Carbon14 in the bunker. The casts room, where the storage team 💾 worked a lot (1) We went full in with diskless boots. The...