2024-04-24 14:12:55 +00:00
|
|
|
# languageM
|
|
|
|
|
2024-04-24 23:30:18 +00:00
|
|
|
*Learn how to fit LLMs (Large Language Models)*
|
2024-04-24 14:12:55 +00:00
|
|
|
|
|
|
|
## Base
|
|
|
|
|
2024-04-25 12:42:03 +00:00
|
|
|
* Models: [Google/Gemma](https://blog.google/technology/developers/gemma-open-models/)
|
2024-04-24 23:30:18 +00:00
|
|
|
* Packages: [transformers](https://huggingface.co/docs/transformers/index), [Datasets](https://huggingface.co/docs/datasets/index), [trl](https://huggingface.co/docs/trl/index)
|
|
|
|
|
|
|
|
## HOW-TO
|
|
|
|
|
|
|
|
1. Preparation: `python -m pip install -r requirements.txt`
|