GitHub Actions cache is limited to 10GB per repository. If you use a lot of cache storage, you may see the following warning message: Approaching total cache storage limit (XX GB of 10 GB Used) Least ...

If you use this repository, please cite the accompanying paper: “Revisiting Replay and Gradient Alignment for Continual Pre-Training of Large Language Models” (2025). See the ** Citation** section ...