<?xml version="1.0" encoding="utf-8" standalone="yes"?><rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom"><channel><title>hugging face on Rise-</title><link>https://madil.in/tag/hugging-face/</link><description>Recent content in hugging face on Rise-</description><generator>Hugo</generator><language>en</language><lastBuildDate>Fri, 27 Dec 2024 14:16:11 +0000</lastBuildDate><atom:link href="https://madil.in/tag/hugging-face/index.xml" rel="self" type="application/rss+xml"/><item><title>TIL - How to run Hugging Face models with Ollama</title><link>https://madil.in/til-how-to-run-hugging-face-models-with-ollama/</link><pubDate>Fri, 27 Dec 2024 14:15:00 +0000</pubDate><guid>https://madil.in/til-how-to-run-hugging-face-models-with-ollama/</guid><description>&lt;p&gt;You can now deploy any GGUF model with Ollama, in just a few clicks!&lt;/p&gt;&#10;&lt;p&gt;You can use any GGUF quants created by the community on Hugging Face directly with Ollama, without the need to create a new &lt;code&gt;Modelfile&lt;/code&gt; . It works like a charm with all llama.cpp compatible models, with all sizes, from 0.1B up to 405B parameters.&lt;/p&gt;&#10;&lt;p&gt;Simply filter GGUF models, select the quant type as per your requirement, and it is done!&lt;/p&gt;</description></item></channel></rss>