{"id":2314,"date":"2026-03-05T05:34:34","date_gmt":"2026-03-05T05:34:34","guid":{"rendered":"https:\/\/hackmybox.com\/?p=2314"},"modified":"2026-03-05T05:42:35","modified_gmt":"2026-03-05T05:42:35","slug":"llm","status":"publish","type":"post","link":"https:\/\/hackmybox.com\/index.php\/2026\/03\/05\/llm\/","title":{"rendered":"Install Local LLM (Quick Guide)"},"content":{"rendered":"\r\n<div class=\"vce-row-container\" data-vce-boxed-width=\"true\">\r\n<div id=\"el-c9c079d7\" class=\"vce-row vce-row--col-gap-30 vce-row-equal-height vce-row-content--top\" data-vce-do-apply=\"all el-c9c079d7\">\r\n<div class=\"vce-row-content\" data-vce-element-content=\"true\">\r\n\r\n\r\n<div id=\"el-f28cad98\" class=\"vce-col vce-col--md-auto vce-col--xs-1 vce-col--xs-last vce-col--xs-first vce-col--sm-last vce-col--sm-first vce-col--md-last vce-col--lg-last vce-col--xl-last vce-col--md-first vce-col--lg-first vce-col--xl-first\">\r\n<div class=\"vce-col-inner\" data-vce-do-apply=\"border margin background el-f28cad98\">\r\n<div class=\"vce-col-content\" data-vce-element-content=\"true\" data-vce-do-apply=\"padding el-f28cad98\">\r\n\r\n\r\n<div class=\"vce-text-block\">\r\n<div id=\"el-b638b9de\" class=\"vce-text-block-wrapper vce\" data-vce-do-apply=\"all el-b638b9de\">\r\n<p data-start=\"183\" data-end=\"719\">This guide will walk you through the process of installing Ollama on a fresh Ubuntu setup, enabling you to run the model on your own hardware without relying on cloud-based services.<\/p>\r\n<p data-start=\"721\" data-end=\"999\"><\/p>\r\n\r\n<\/div>\r\n<\/div>\r\n\r\n<div class=\"vce-text-block\">\r\n<div id=\"el-79411d63\" class=\"vce-text-block-wrapper vce\" data-vce-do-apply=\"all el-79411d63\">\r\n\r\n<strong>1. Install curl\u00a0<\/strong>\r\nsudo apt update\r\nsudo apt install curl -y\r\n\r\n<strong>2. Install Ollama<\/strong>\r\n<span style=\"color: #ffff00;\">curl -fsSL https:\/\/ollama.com\/install.sh | sh<\/span>\r\n\r\nVerify:\r\n\r\nollama --version\r\n\r\n<\/div>\r\n<\/div>\r\n\r\n<div class=\"vce-single-image-container vce-single-image--align-left\">\r\n<div id=\"el-a61a411c\" class=\"vce vce-single-image-wrapper\" data-vce-do-apply=\"all el-a61a411c\">\r\n<figure>\r\n<div class=\"vce-single-image-figure-inner\" style=\"width: 1024px;\">\r\n<div class=\"vce-single-image-inner vce-single-image--absolute\" style=\"width: 100%; padding-bottom: 81.6406%;\"><img loading=\"lazy\" decoding=\"async\" class=\"vce-single-image\" title=\"Install\" src=\"https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/03\/Install-1024x837.png\" srcset=\"https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/03\/Install-1024x837.png 1024w, https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/03\/Install-320x261.png 320w, https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/03\/Install-480x392.png 480w, https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/03\/Install-800x654.png 800w\" alt=\"\" width=\"1024\" height=\"836\" data-img-src=\"https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/03\/Install.png\" data-attachment-id=\"2317\" \/><\/div>\r\n<\/div>\r\n<figcaption hidden=\"\"><\/figcaption><\/figure>\r\n<\/div>\r\n<\/div>\r\n\r\n<div class=\"vce-text-block\">\r\n<div id=\"el-50ab97e4\" class=\"vce-text-block-wrapper vce\" data-vce-do-apply=\"all el-50ab97e4\">\r\n\r\n3. Run a Model\r\n\r\nExample (recommended for CPU):\r\n\r\n<span style=\"color: #ffff00;\">ollama run llama3:8b<\/span>\r\n\r\nOr faster 7B option:\r\n\r\n<span style=\"color: #ffff00;\">ollama run mistral:7b<\/span>\r\n\r\nFirst run will download the model\r\n\r\n<\/div>\r\n<\/div>\r\n\r\n<div class=\"vce-single-image-container vce-single-image--align-left\">\r\n<div id=\"el-8f971a89\" class=\"vce vce-single-image-wrapper\" data-vce-do-apply=\"all el-8f971a89\">\r\n<figure>\r\n<div class=\"vce-single-image-figure-inner\" style=\"width: 1024px;\">\r\n<div class=\"vce-single-image-inner vce-single-image--absolute\" style=\"width: 100%; padding-bottom: 81.6406%;\"><img loading=\"lazy\" decoding=\"async\" class=\"vce-single-image\" title=\"run\" src=\"https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/03\/run-1024x837.png\" srcset=\"https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/03\/run-1024x837.png 1024w, https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/03\/run-320x261.png 320w, https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/03\/run-480x392.png 480w, https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/03\/run-800x654.png 800w\" alt=\"\" width=\"1024\" height=\"836\" data-img-src=\"https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/03\/run.png\" data-attachment-id=\"2320\" \/><\/div>\r\n<\/div>\r\n<figcaption hidden=\"\"><\/figcaption><\/figure>\r\n<\/div>\r\n<\/div>\r\n\r\n<div class=\"vce-text-block\">\r\n<div id=\"el-21db160d\" class=\"vce-text-block-wrapper vce\" data-vce-do-apply=\"all el-21db160d\">\r\n\r\n4. Monitor CPU \/ RAM (Optional)\r\n<span style=\"color: #ffff00;\">sudo apt install htop -y<\/span>\r\nhtop\r\n\r\n<\/div>\r\n<\/div>\r\n\r\n<div class=\"vce-single-image-container vce-single-image--align-left\">\r\n<div id=\"el-110f508a\" class=\"vce vce-single-image-wrapper\" data-vce-do-apply=\"all el-110f508a\">\r\n<figure>\r\n<div class=\"vce-single-image-figure-inner\" style=\"width: 1024px;\">\r\n<div class=\"vce-single-image-inner vce-single-image--absolute\" style=\"width: 100%; padding-bottom: 81.6406%;\"><img loading=\"lazy\" decoding=\"async\" class=\"vce-single-image\" title=\"htop\" src=\"https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/03\/htop-1024x837.png\" srcset=\"https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/03\/htop-1024x837.png 1024w, https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/03\/htop-320x261.png 320w, https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/03\/htop-480x392.png 480w, https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/03\/htop-800x654.png 800w\" alt=\"\" width=\"1024\" height=\"836\" data-img-src=\"https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/03\/htop.png\" data-attachment-id=\"2322\" \/><\/div>\r\n<\/div>\r\n<figcaption hidden=\"\"><\/figcaption><\/figure>\r\n<\/div>\r\n<\/div>\r\n\r\n<div class=\"vce-text-block\">\r\n<div id=\"el-92dfd381\" class=\"vce-text-block-wrapper vce\" data-vce-do-apply=\"all el-92dfd381\">\r\n\r\n5. Start interactive chat\r\n\r\n<\/div>\r\n<\/div>\r\n\r\n<div class=\"vce-single-image-container vce-single-image--align-left\">\r\n<div id=\"el-262311a4\" class=\"vce vce-single-image-wrapper\" data-vce-do-apply=\"all el-262311a4\">\r\n<figure>\r\n<div class=\"vce-single-image-figure-inner\" style=\"width: 1024px;\">\r\n<div class=\"vce-single-image-inner vce-single-image--absolute\" style=\"width: 100%; padding-bottom: 81.6406%;\"><img loading=\"lazy\" decoding=\"async\" class=\"vce-single-image\" title=\"chat\" src=\"https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/03\/chat-1024x837.png\" srcset=\"https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/03\/chat-1024x837.png 1024w, https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/03\/chat-320x261.png 320w, https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/03\/chat-480x392.png 480w, https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/03\/chat-800x654.png 800w\" alt=\"\" width=\"1024\" height=\"836\" data-img-src=\"https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/03\/chat.png\" data-attachment-id=\"2324\" \/><\/div>\r\n<\/div>\r\n<figcaption hidden=\"\"><\/figcaption><\/figure>\r\n<\/div>\r\n<\/div>\r\n\r\n\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n\r\n\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n\n","protected":false},"excerpt":{"rendered":"<p>This guide will walk you through the process of installing Ollama on a fresh Ubuntu setup, enabling you to run the model on your own hardware without relying on cloud-based services. 1. Install curl\u00a0 sudo apt update sudo apt install curl -y 2. Install Ollama curl -fsSL https:\/\/ollama.com\/install.sh | sh Verify: ollama &#8211;version 3. Run [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":2331,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"site-container-style":"default","site-container-layout":"default","site-sidebar-layout":"default","site-transparent-header":"default","prose-style":"enable","disable-article-header":"default","disable-site-header":"default","disable-site-footer":"default","disable-content-area-spacing":"default","footnotes":""},"categories":[12],"tags":[],"class_list":["post-2314","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-labs"],"_links":{"self":[{"href":"https:\/\/hackmybox.com\/index.php\/wp-json\/wp\/v2\/posts\/2314","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/hackmybox.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/hackmybox.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/hackmybox.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/hackmybox.com\/index.php\/wp-json\/wp\/v2\/comments?post=2314"}],"version-history":[{"count":15,"href":"https:\/\/hackmybox.com\/index.php\/wp-json\/wp\/v2\/posts\/2314\/revisions"}],"predecessor-version":[{"id":2336,"href":"https:\/\/hackmybox.com\/index.php\/wp-json\/wp\/v2\/posts\/2314\/revisions\/2336"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/hackmybox.com\/index.php\/wp-json\/wp\/v2\/media\/2331"}],"wp:attachment":[{"href":"https:\/\/hackmybox.com\/index.php\/wp-json\/wp\/v2\/media?parent=2314"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/hackmybox.com\/index.php\/wp-json\/wp\/v2\/categories?post=2314"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/hackmybox.com\/index.php\/wp-json\/wp\/v2\/tags?post=2314"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}