{"id":2585,"date":"2026-09-16T13:30:53","date_gmt":"2026-09-16T13:30:53","guid":{"rendered":"https:\/\/hackmybox.com\/?p=2585"},"modified":"2026-09-21T05:15:42","modified_gmt":"2026-09-21T05:15:42","slug":"ai","status":"publish","type":"post","link":"https:\/\/hackmybox.com\/index.php\/2026\/09\/16\/ai\/","title":{"rendered":"My Journey into Open AI: Exploring K2 Horizon"},"content":{"rendered":"<div class=\"vce-row-container\" data-vce-boxed-width=\"true\"><div class=\"vce-row vce-row--col-gap-30 vce-row-equal-height vce-row-content--top\" id=\"el-49b39b7b\" data-vce-do-apply=\"all el-49b39b7b\"><div class=\"vce-row-content\" data-vce-element-content=\"true\"><div class=\"vce-col vce-col--md-auto vce-col--xs-1 vce-col--xs-last vce-col--xs-first vce-col--sm-last vce-col--sm-first vce-col--md-last vce-col--lg-last vce-col--xl-last vce-col--md-first vce-col--lg-first vce-col--xl-first\" id=\"el-d99d7b0c\"><div class=\"vce-col-inner\" data-vce-do-apply=\"border margin background  el-d99d7b0c\"><div class=\"vce-col-content\" data-vce-element-content=\"true\" data-vce-do-apply=\"padding el-d99d7b0c\"><div class=\"vce-text-block\"><div class=\"vce-text-block-wrapper vce\" id=\"el-e1fd85b7\" data-vce-do-apply=\"all el-e1fd85b7\"><p><span style=\"color: #ffff00;\">Background:<\/span><\/p><p>MBZUAI\u2019s Institute of Foundation Models (IFM) has launched K2 Horizon, a family of six fully open AI models ranging from 0.9B to 375B parameters.<\/p><\/div><\/div><div class=\"vce-text-block\"><div class=\"vce-text-block-wrapper vce\" id=\"el-3a0eb972\" data-vce-do-apply=\"all el-3a0eb972\"><p><span style=\"color: #ffff00;\">Goal:<\/span><\/p><p>Explore K2 Horizon and see how far I can go with open-source AI using hardware I already have.<\/p><\/div><\/div><div class=\"vce-text-block\"><div class=\"vce-text-block-wrapper vce\" id=\"el-a854af3d\" data-vce-do-apply=\"all el-a854af3d\"><p><span style=\"color: #ffff00;\">Hardware:<\/span><\/p><p>HP Z420&nbsp;<\/p><p>32 GB Memory<\/p><p>Nvidia 3060 12GB<\/p><\/div><\/div><div class=\"vce-text-block\"><div class=\"vce-text-block-wrapper vce\" id=\"el-c24247ae\" data-vce-do-apply=\"all el-c24247ae\"><p><span style=\"color: #ffff00;\">Installation &amp; Testing:<\/span><\/p><\/div><\/div><div class=\"vce-text-block\"><div class=\"vce-text-block-wrapper vce\" id=\"el-97a3af3d\" data-vce-do-apply=\"all el-97a3af3d\"><p><span style=\"color: #00ff00;\">1.<\/span> Downloaded the GGUF model<\/p><\/div><\/div><div class=\"vce-single-image-container vce-single-image--align-left\"><div class=\"vce vce-single-image-wrapper\" id=\"el-5b16d1bd\" data-vce-do-apply=\"all el-5b16d1bd\"><figure><div class=\"vce-single-image-figure-inner\" style=\"width: 1024px;\"><div class=\"vce-single-image-inner vce-single-image--absolute\" style=\"width: 100%; padding-bottom: 8.59375%;\"><img loading=\"lazy\" decoding=\"async\" class=\"vce-single-image\"  width=\"1024\" height=\"88\" srcset=\"https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/09\/download1-1024x88.png 1024w, https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/09\/download1-320x28.png 320w, https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/09\/download1-480x41.png 480w, https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/09\/download1-800x69.png 800w\" src=\"https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/09\/download1-1024x88.png\" data-img-src=\"https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/09\/download1.png\" data-attachment-id=\"2587\"  alt=\"\" title=\"download1\" \/><\/div><\/div><figcaption hidden=\"\"><\/figcaption><\/figure><\/div><\/div><div class=\"vce-text-block\"><div class=\"vce-text-block-wrapper vce\" id=\"el-b1a56920\" data-vce-do-apply=\"all el-b1a56920\"><p><span style=\"color: #00ff00;\">2.<\/span> Verified the llama.cpp build<\/p><\/div><\/div><div class=\"vce-single-image-container vce-single-image--align-left\"><div class=\"vce vce-single-image-wrapper\" id=\"el-7a757870\" data-vce-do-apply=\"all el-7a757870\"><figure><div class=\"vce-single-image-figure-inner\" style=\"width: 1024px;\"><div class=\"vce-single-image-inner vce-single-image--absolute\" style=\"width: 100%; padding-bottom: 7.22656%;\"><img loading=\"lazy\" decoding=\"async\" class=\"vce-single-image\"  width=\"1024\" height=\"74\" srcset=\"https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/09\/llma-1024x75.png 1024w, https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/09\/llma-320x23.png 320w, https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/09\/llma-480x35.png 480w, https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/09\/llma-800x58.png 800w\" src=\"https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/09\/llma-1024x75.png\" data-img-src=\"https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/09\/llma.png\" data-attachment-id=\"2588\"  alt=\"\" title=\"llma\" \/><\/div><\/div><figcaption hidden=\"\"><\/figcaption><\/figure><\/div><\/div><div class=\"vce-text-block\"><div class=\"vce-text-block-wrapper vce\" id=\"el-4a187ce7\" data-vce-do-apply=\"all el-4a187ce7\"><p><span style=\"color: #00ff00;\">3.<\/span> Checked CUDA support&nbsp;<\/p><\/div><\/div><div class=\"vce-single-image-container vce-single-image--align-left\"><div class=\"vce vce-single-image-wrapper\" id=\"el-aa58e317\" data-vce-do-apply=\"all el-aa58e317\"><figure><div class=\"vce-single-image-figure-inner\" style=\"width: 1024px;\"><div class=\"vce-single-image-inner vce-single-image--absolute\" style=\"width: 100%; padding-bottom: 23.7305%;\"><img loading=\"lazy\" decoding=\"async\" class=\"vce-single-image\"  width=\"1024\" height=\"243\" srcset=\"https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/09\/verify-1024x244.png 1024w, https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/09\/verify-320x76.png 320w, https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/09\/verify-480x114.png 480w, https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/09\/verify-800x190.png 800w\" src=\"https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/09\/verify-1024x244.png\" data-img-src=\"https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/09\/verify.png\" data-attachment-id=\"2589\"  alt=\"\" title=\"verify\" \/><\/div><\/div><figcaption hidden=\"\"><\/figcaption><\/figure><\/div><\/div><div class=\"vce-text-block\"><div class=\"vce-text-block-wrapper vce\" id=\"el-f3254fb5\" data-vce-do-apply=\"all el-f3254fb5\"><p><span style=\"color: #00ff00;\">4.<\/span> Launched the model&nbsp;<\/p><\/div><\/div><div class=\"vce-single-image-container vce-single-image--align-left\"><div class=\"vce vce-single-image-wrapper\" id=\"el-afc57401\" data-vce-do-apply=\"all el-afc57401\"><figure><div class=\"vce-single-image-figure-inner\" style=\"width: 1024px;\"><div class=\"vce-single-image-inner vce-single-image--absolute\" style=\"width: 100%; padding-bottom: 34.375%;\"><img loading=\"lazy\" decoding=\"async\" class=\"vce-single-image\"  width=\"1024\" height=\"352\" srcset=\"https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/09\/launch-1024x352.png 1024w, https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/09\/launch-320x110.png 320w, https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/09\/launch-480x165.png 480w, https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/09\/launch-800x275.png 800w\" src=\"https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/09\/launch-1024x352.png\" data-img-src=\"https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/09\/launch.png\" data-attachment-id=\"2590\"  alt=\"\" title=\"launch\" \/><\/div><\/div><figcaption hidden=\"\"><\/figcaption><\/figure><\/div><\/div><div class=\"vce-text-block\"><div class=\"vce-text-block-wrapper vce\" id=\"el-06ffc223\" data-vce-do-apply=\"all el-06ffc223\"><p>* <span style=\"color: #00ff00;\">ngl 99 -c 8192<\/span>: This allows the model layers to be offloaded to the GPU.<\/p><\/div><\/div><div class=\"vce-text-block\"><div class=\"vce-text-block-wrapper vce\" id=\"el-1b095f43\" data-vce-do-apply=\"all el-1b095f43\"><p><span style=\"color: #00ff00;\">5.<\/span> Testing<\/p><\/div><\/div><div class=\"vce-text-block\"><div class=\"vce-text-block-wrapper vce\" id=\"el-3b4a9537\" data-vce-do-apply=\"all el-3b4a9537\"><p>The model produced fast and coherent responses during testing.<\/p><\/div><\/div><div class=\"vce-single-image-container vce-single-image--align-left\"><div class=\"vce vce-single-image-wrapper\" id=\"el-486c6544\" data-vce-do-apply=\"all el-486c6544\"><figure><div class=\"vce-single-image-figure-inner\" style=\"width: 1024px;\"><div class=\"vce-single-image-inner vce-single-image--absolute\" style=\"width: 100%; padding-bottom: 26.6602%;\"><img loading=\"lazy\" decoding=\"async\" class=\"vce-single-image\"  width=\"1024\" height=\"273\" srcset=\"https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/09\/test1-1024x273.png 1024w, https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/09\/test1-320x85.png 320w, https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/09\/test1-480x128.png 480w, https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/09\/test1-800x213.png 800w\" src=\"https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/09\/test1-1024x273.png\" data-img-src=\"https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/09\/test1.png\" data-attachment-id=\"2593\"  alt=\"\" title=\"test1\" \/><\/div><\/div><figcaption hidden=\"\"><\/figcaption><\/figure><\/div><\/div><div class=\"vce-single-image-container vce-single-image--align-left\"><div class=\"vce vce-single-image-wrapper\" id=\"el-0de829cc\" data-vce-do-apply=\"all el-0de829cc\"><figure><div class=\"vce-single-image-figure-inner\" style=\"width: 1024px;\"><div class=\"vce-single-image-inner vce-single-image--absolute\" style=\"width: 100%; padding-bottom: 42.9688%;\"><img loading=\"lazy\" decoding=\"async\" class=\"vce-single-image\"  width=\"1024\" height=\"440\" srcset=\"https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/09\/test-2-1024x440.png 1024w, https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/09\/test-2-320x138.png 320w, https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/09\/test-2-480x206.png 480w, https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/09\/test-2-800x344.png 800w\" src=\"https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/09\/test-2-1024x440.png\" data-img-src=\"https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/09\/test-2.png\" data-attachment-id=\"2594\"  alt=\"\" title=\"test 2\" \/><\/div><\/div><figcaption hidden=\"\"><\/figcaption><\/figure><\/div><\/div><div class=\"vce-single-image-container vce-single-image--align-left\"><div class=\"vce vce-single-image-wrapper\" id=\"el-f1a41ed9\" data-vce-do-apply=\"all el-f1a41ed9\"><figure><div class=\"vce-single-image-figure-inner\" style=\"width: 1024px;\"><div class=\"vce-single-image-inner vce-single-image--absolute\" style=\"width: 100%; padding-bottom: 37.793%;\"><img loading=\"lazy\" decoding=\"async\" class=\"vce-single-image\"  width=\"1024\" height=\"387\" srcset=\"https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/09\/test-3-1024x387.png 1024w, https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/09\/test-3-320x121.png 320w, https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/09\/test-3-480x181.png 480w, https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/09\/test-3-800x302.png 800w\" src=\"https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/09\/test-3-1024x387.png\" data-img-src=\"https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/09\/test-3.png\" data-attachment-id=\"2595\"  alt=\"\" title=\"test 3\" \/><\/div><\/div><figcaption hidden=\"\"><\/figcaption><\/figure><\/div><\/div><div class=\"vce-text-block\"><div class=\"vce-text-block-wrapper vce\" id=\"el-e3b8fec9\" data-vce-do-apply=\"all el-e3b8fec9\"><table width=\"372\"><tbody><tr><td width=\"92\">Metric<\/td><td width=\"87\">Value<\/td><td width=\"193\">&nbsp;<\/td><\/tr><tr><td width=\"92\">Prompt<\/td><td width=\"87\">149.4 t\/s<\/td><td width=\"193\">Time-to-first-token speed.&nbsp;<\/td><\/tr><tr><td width=\"92\">Generation<\/td><td width=\"87\">121.2 t\/s<\/td><td width=\"193\">Token output speed.<\/td><\/tr><\/tbody><\/table><\/div><\/div><div class=\"vce-text-block\"><div class=\"vce-text-block-wrapper vce\" id=\"el-e7974fb6\" data-vce-do-apply=\"all el-e7974fb6\"><p><span style=\"color: #00ff00;\">5.<\/span> Monitoring<\/p><\/div><\/div><div class=\"vce-single-image-container vce-single-image--align-left\"><div class=\"vce vce-single-image-wrapper\" id=\"el-1a7dcf66\" data-vce-do-apply=\"all el-1a7dcf66\"><figure><div class=\"vce-single-image-figure-inner\" style=\"width: 1024px;\"><div class=\"vce-single-image-inner vce-single-image--absolute\" style=\"width: 100%; padding-bottom: 35.4492%;\"><img loading=\"lazy\" decoding=\"async\" class=\"vce-single-image\"  width=\"1024\" height=\"363\" srcset=\"https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/09\/monitor-e1789539867448-1024x364.png 1024w, https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/09\/monitor-e1789539867448-320x114.png 320w, https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/09\/monitor-e1789539867448-480x171.png 480w, https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/09\/monitor-e1789539867448-800x284.png 800w\" src=\"https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/09\/monitor-e1789539867448-1024x364.png\" data-img-src=\"https:\/\/hackmybox.com\/wp-content\/uploads\/2026\/09\/monitor-e1789539867448.png\" data-attachment-id=\"2596\"  alt=\"\" title=\"monitor\" \/><\/div><\/div><figcaption hidden=\"\"><\/figcaption><\/figure><\/div><\/div><div class=\"vce-text-block\"><div class=\"vce-text-block-wrapper vce\" id=\"el-79463414\" data-vce-do-apply=\"all el-79463414\"><table width=\"458\"><tbody><tr><td width=\"70\">Metric<\/td><td width=\"87\">Result<\/td><td width=\"301\">Description<\/td><\/tr><tr><td width=\"70\">GPU Memory<\/td><td width=\"87\">2504 MiB<\/td><td width=\"301\">Model loaded into VRAM<\/td><\/tr><tr><td width=\"70\">GPU Utilization<\/td><td width=\"87\">96% SM<\/td><td width=\"301\">GPU heavily utilized<\/td><\/tr><tr><td width=\"70\">CPU<\/td><td width=\"87\">102.10%<\/td><td width=\"301\">CPU handling supporting tasks such as tokenization\/IO<\/td><\/tr><tr><td width=\"70\">GPU Time<\/td><td width=\"87\">0:48<\/td><td width=\"301\">48 seconds of GPU time<\/td><\/tr><tr><td width=\"70\">GPU Offload<\/td><td width=\"87\">-ngl 99<\/td><td width=\"301\">All available model layers offloaded<\/td><\/tr><\/tbody><\/table><\/div><\/div><div class=\"vce-text-block\"><div class=\"vce-text-block-wrapper vce\" id=\"el-d198acff\" data-vce-do-apply=\"all el-d198acff\"><\/div><\/div><div class=\"vce-text-block\"><div class=\"vce-text-block-wrapper vce\" id=\"el-83bbe349\" data-vce-do-apply=\"all el-83bbe349\"><p><span style=\"color: #ffff00;\">Summary<\/span><\/p><\/div><\/div><div class=\"vce-text-block\"><div class=\"vce-text-block-wrapper vce\" id=\"el-f1580936\" data-vce-do-apply=\"all el-f1580936\"><p>Starting my journey&nbsp; by exploring K2 Horizon a fully open family of AI models. Tested local inference with llama.cpp and CUDA achieving 121 tokens\/sec generation speed.<\/p><\/div><\/div><\/div><\/div><\/div><\/div><\/div><\/div>\n","protected":false},"excerpt":{"rendered":"<p>Background:MBZUAI\u2019s Institute of Foundation Models (IFM) has launched K2 Horizon, a family of six fully open AI models ranging from 0.9B to 375B parameters.Goal:Explore K2 Horizon and see how far I can go with open-source AI using hardware I already have.Hardware:HP Z420&nbsp;32 GB MemoryNvidia 3060 12GBInstallation &amp; Testing:1. Downloaded the GGUF model2. Verified the llama.cpp [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":2611,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"site-container-style":"default","site-container-layout":"default","site-sidebar-layout":"default","site-transparent-header":"default","prose-style":"enable","disable-article-header":"default","disable-site-header":"default","disable-site-footer":"default","disable-content-area-spacing":"default","footnotes":""},"categories":[12],"tags":[],"class_list":["post-2585","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-labs"],"_links":{"self":[{"href":"https:\/\/hackmybox.com\/index.php\/wp-json\/wp\/v2\/posts\/2585","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/hackmybox.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/hackmybox.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/hackmybox.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/hackmybox.com\/index.php\/wp-json\/wp\/v2\/comments?post=2585"}],"version-history":[{"count":19,"href":"https:\/\/hackmybox.com\/index.php\/wp-json\/wp\/v2\/posts\/2585\/revisions"}],"predecessor-version":[{"id":2615,"href":"https:\/\/hackmybox.com\/index.php\/wp-json\/wp\/v2\/posts\/2585\/revisions\/2615"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/hackmybox.com\/index.php\/wp-json\/wp\/v2\/media\/2611"}],"wp:attachment":[{"href":"https:\/\/hackmybox.com\/index.php\/wp-json\/wp\/v2\/media?parent=2585"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/hackmybox.com\/index.php\/wp-json\/wp\/v2\/categories?post=2585"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/hackmybox.com\/index.php\/wp-json\/wp\/v2\/tags?post=2585"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}