Articles, guides and deep dives from the QVAC team.
We built Genesis III to push small models as far as they can go on STEM. A 1.7B model trained on it answers more than twice as many questions correctly as the same model trained on the open alternative, from an identical token budget.
Read More
Building upon the success of Genesis I, we introduce QVAC Genesis II, a major expansion that adds new domains and a total of 148 billion tokens.
Read More
There is a need for publicly available, large-scale synthetic datasets that are rigorously curated. Genesis I is our first effort in this direction.
Read More
