Splitting Light: Season 1 - Episode 38


Splitting light

Season 1 Episode 38

ECMP / Tunneling

If you are no longer interested in the newsletter, please unsubscribe

The network chips we used had many more features that we had implemented in software. As the complexity of how the devices were used and set up in production, it raised the rationale to use more and more of the advanced chip features.

It’s one thing to have routing capability, it’s a better one to have multipath routing capabilities. The multipath capability enables sending packets, data split up in small portions, through multiple links. On the compute hardware, we had four 10 gigabit links, it would be better to be able to use multiple links on the same path. That would bring the capacity to 20 or 40 gigabit if we aggregated.

Unlike bonding capabilities, which I had also looked in, it had a much better compatibility with various devices. The way this worked was that you configured the chip to send a portion of the traffic through a path depending on parts of the data of the packets. It would create a hash based on specific parts of the data to be able to deterministically send the data to the correct link. This required some rework in our code but the hardest part was actually testing it out.

That required producing the setup and manually checking which link had the packet exited from. Many small details had to be accommodated. The netlink interface had to be patched, the routing code had to be patched, the interface had to be patched… And everything tested to be accurate. This simple user feature was complex behind the scenes.

The next one was tunneling. This was also a feature available in the chip. I started looking into it and preparing the implementation but the doubts from the SerDes eye encounter got stronger and stronger. I had trouble understanding how it worked and unlike every previous encounter with things I initially did not understand where I would push through, this time I did not.

Hindsight is a very powerful tool. Unfortunately it only works on the past. It is very clear to me that multiple things contributed to my state at the time. The lack of self confidence had caused the SerDes eye failure which, in turn, triggered this whole “I do not belong here”. I thought this was the reason why I had not been assigned EDA work yet. This was the reason I could not do the tunneling or understand the very dense LACP specification documentation.

Or at least, I believed that. It wasn’t rational. It wasn’t based on the track record. It wasn’t based on the actual interactions and work friendships I had. It was a belief that I was an imposter. But it wasn’t true.

In that mix, there was also four years of metaphorical blood and sweat. Four years of pushing forward, pushing again and again my knowledge and skill boundaries. A never ending learning curve that kept rising steeply. I was tired. My brain was saturated. I hadn’t taken a proper vacation or break in these four years. That had a cost. But I could not understand it, not yet at least.

Changes were about to happen.

If you have missed it, you can read the previous episode here

To pair with :

  • Bad girls - M.I.A.
  • Big Planet by Jack Vance

Vincent Auclair

Connect with me on your favorite network!

Oud metha, Dubai, Dubai 00000
Unsubscribe · Preferences

Symbol Sled

Business, tech, and life by a nerd. New every Tuesday: Splitting Light: The Prism of Growth and Discovery.

Read more from Symbol Sled

Splitting light Season 2 Episode 03 Remote hands If you are no longer interested in the newsletter, please unsubscribe Even before we could do anything other than look at what object and block storage were, we had to assure the continuity of the existing products. That meant getting the people who used to take care of them to give us all the information they knew and what we needed to continue running them. One thing helped us very much. Both Folays and Loic had worked on some of the...

Splitting light Season 2 Episode 02 Birth of team storage 💾 If you are no longer interested in the newsletter, please unsubscribe The five of us had been tasked to build two new products in the short term. Object and block storage. What we had missed was that we would pick-up all the existing storage products as well. At the time, in the cloud department there had already been two tries at object storage, the first one had been a public offering based on RiakCS, a now defunct database. The...

Splitting light Season 2 Episode 01 51 avenue Iena If you are no longer interested in the newsletter, please unsubscribe November 2017, the cloud industry was now booming. AWS was 11 years old, Azure was 9 years old, GCP was 6 years old and Oracle Cloud was now 2 years old. For me, the adventure continued but on a different wavelength. I had jumped energy level, and it was a whole new light. The storage team was created. There were initially five of us. Me, the lead engineer, Théo the manager...