Interstella: Token Cosmos Traversal for AGI Emergence
Traversing Semantic Black Holes Towards AGI
"We must reach far beyond our own lifespans."
Project Vision
AGI through manifold traversals in the token cosmos of large language models, enabling emergent insights and AHA moments.
Semantic Spaces
Treating LLM token embeddings as a cosmos, with traversals representing leaps to new insights – like crossing event horizons.
Mathematical Framework
Differential geometry and random dynamical systems for modeling uncertainty and reachability, inspired by wormhole navigation.
Engineering Pipeline
A 5-layer system: Navigator, Trajectory Generator, Verifier, Semantic Map, Learning Loop – engineering the path to ASI.
Key Concepts
Token Cosmos
The metaphorical universe of semantic spaces in LLMs, where tokens are stars and embeddings form galaxies – traversals as interstellar journeys.
Fisher Metric
$$ g_{ij} = \mathbb{E} \left[ \frac{\partial \log p}{\partial \theta_i} \frac{\partial \log p}{\partial \theta_j} \right] $$
Information geometry for measuring distances in parameter space, guiding leaps across semantic black holes.
Morse Theory Leaps
Critical points and topology changes representing emergent AGI capabilities – AHA moments as crossing dimensional barriers.
Teaser: Token Trajectory Bundle
Explore the paths to emergence through our research.