Repository files navigation

This repository is part ofplaybook for experiments on fine tuning small language models using LoRA, exporting them to ONNX and running them locally using ONNX compatibale runtime like javascript(node js) and WASM (browser)

• Clone the repository.
• Fromhttps://huggingface.co/code2022/SmolLM2-135M-Instruct-Paraphrase/tree/maincopymodel.onnx to themodel_files directory of the repository.
• Runnpm install

• Simple runnode app.js

This is what you should see

• Simply accessweb.html from a local server (examplehttp://localhost:3000/web.html)

This is what you should see

https://www.kaggle.com/code/finalepoch/fine-tuning-smollm2-135m-for-paraphrasing-tasks

https://www.kaggle.com/code/finalepoch/smollm-360-lora-onnx-inference

@misc{allal2024SmolLM,      title={SmolLM - blazingly fast and remarkably powerful},       author={Loubna Ben Allal and Anton Lozhkov and Elie Bakouch and Leandro von Werra and Thomas Wolf},      year={2024},}