SanderLang

The idea of this framework is motivated by a North American bird - SanderLing - and came to me while I was listening to NPR's BirdNotes.

This framework aims to make the training and deployment of task-specific and Small Language Models seamless. Each of these task-specific SLMs will serve a specialized agent. There will be many of them, just like a flock of SanderLings.

Intuition

When I started web development, I chose Scala as my first choice because back then most of the NLP frameworks were JVM-based. Another reason was the actor-based model of Scala that mimicked Erlang's actor's model. In a talk that I highly recommend - Joe Armstrong shares a simple yet profound idea: you can have many many but small parallel programs doing very small tasks, instead of few big tasks doing heavy computations. This is related to the KnapSack problem.