Llama – Rugburn

Llama – Rugburn https://rugburn.dev Software Development Sat, 30 Aug 2025 19:24:35 +0000 en-US hourly 1 https://wordpress.org/?v=6.9.1 https://i0.wp.com/rugburn.dev/wp-content/uploads/2025/07/20250729_2055_Software-Developer-Logo_remix_01k1cghcbzfzy8hv45v6gsykj2.webp?fit=32%2C32&ssl=1 Llama – Rugburn https://rugburn.dev 32 32 244879875 Building Testing Datasets with Hugging Face API https://rugburn.dev/building-testing-datasets-with-hugging-face-api/ Sat, 30 Aug 2025 19:23:51 +0000 https://rugburn.dev/?p=551

Skills

Hugging Face API to load and run open source model
Transformers
- Tokenizer to apply chat template
- Quantization to reduce model size for use on Colab T4 Box.
Gradio for demo UI development
Multishot Prompting to enforce multiple output formats
Google Colab with use of the T4 GPU box

]]>

551