Interactive code editors have been around for a while now, and tools like GitHub Copilot have woven their way into most development pipelines, and for good reason. They\u2019re easy to use, exceptionally helpful (at certain tasks), and have undeniably made life as a developer smoother. Recently, I decided to switch away from relying on GitHub Copilot in favour of a local model for a few key reasons. While I don\u2019t use it all the time, it has proven to be a useful option in many situations. In this blog post, I\u2019ll go over why I made the switch, how I set it up, and share a bit about my experience so far.<\/p>\n\n\n\n\n\n\n\n
There are plenty of cloud-based solutions available, and if you\u2019re like me and do most of your work in VSCode, GitHub Copilot is probably your go-to. It\u2019s easy to use, provides access to some of the best models, and, if you\u2019re a student it\u2019s free, making it an obvious choice. That said, there are several reasons why you might consider a local copilot instead.<\/p>\n\n\n\n
For me, the biggest factor is privacy. When working on unpublished code, keeping everything local ensures that sensitive information never leaves my environment. Is this level of caution necessary? Maybe not. But I\u2019d rather err on the side of caution. Performance is another key reason. Small models have improved significantly, and good models have become much more lightweight. Not long ago, running a decent copilot required substantial computing power, but now, my MacBook Air is more than capable of handling a local model. Is it the best option available? No, but for what I need from a copilot, it\u2019s more than enough.<\/p>\n\n\n\n
Control is another advantage. A local setup allows me to customise and configure my tools to fit my specific workflow without relying on external servers. Finally, there\u2019s the benefit of offline access. With a local copilot, I\u2019m not dependent on an internet connection, which means I can keep working efficiently anywhere, even when traveling.<\/p>\n\n\n\n
In general, I like to keep thing simple, my tools of choice are Ollama<\/a> and Continue<\/a>. They are easy to set up, and well documented with easy installation.<\/p>\n\n\n\n My experience using a local AI-powered coding assistant has been largely positive, but with some caveats. For certain tasks, such as simple function creation, error management, documentation, best practices, efficiency optimisation, and learning, these tools are fantastic. These aren\u2019t groundbreaking challenges, nor do they require deep problem-solving, but they are essential parts of development that need to be done well. In these cases, Continue and any reasonable LLM make my life noticeably easier, they speed up repetitive tasks, provide quick suggestions, and are generally easy to verify. However, for more complex tasks, larger project-level challenges, or niche library integration, I\u2019ve found that they require much more careful prompting to be useful. In many cases, the time spent crafting a prompt that yields a valuable response outweighs the benefits, making traditional methods more efficient. Overall, these tools are a great addition to my workflow, a helpful assistant rather than a replacement. While they aren\u2019t quite reliable enough for serious, high-stakes projects, they are still a valuable option to have, making everyday coding smoother and more enjoyable. <\/p>\n","protected":false},"excerpt":{"rendered":" Interactive code editors have been around for a while now, and tools like GitHub Copilot have woven their way into most development pipelines, and for good reason. They\u2019re easy to use, exceptionally helpful (at certain tasks), and have undeniably made life as a developer smoother. Recently, I decided to switch away from relying on GitHub […]<\/p>\n","protected":false},"author":75,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"nf_dc_page":"","wikipediapreview_detectlinks":true,"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"ngg_post_thumbnail":0,"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[633,29,296],"tags":[842,152],"ppma_author":[553],"class_list":["post-12307","post","type-post","status-publish","format-standard","hentry","category-ai","category-code","category-hints-and-tips","tag-development","tag-python"],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"authors":[{"term_id":553,"user_id":75,"is_guest":0,"slug":"maranga","display_name":"Maranga Mokaya","avatar_url":"https:\/\/secure.gravatar.com\/avatar\/1fdf4dab73e0e7c801c72c921e529f4827e4af020e7f9124bde0a4adc1cb861b?s=96&d=mm&r=g","0":null,"1":"","2":"","3":"","4":"","5":"","6":"","7":"","8":""}],"_links":{"self":[{"href":"https:\/\/www.blopig.com\/blog\/wp-json\/wp\/v2\/posts\/12307","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.blopig.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.blopig.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.blopig.com\/blog\/wp-json\/wp\/v2\/users\/75"}],"replies":[{"embeddable":true,"href":"https:\/\/www.blopig.com\/blog\/wp-json\/wp\/v2\/comments?post=12307"}],"version-history":[{"count":4,"href":"https:\/\/www.blopig.com\/blog\/wp-json\/wp\/v2\/posts\/12307\/revisions"}],"predecessor-version":[{"id":12325,"href":"https:\/\/www.blopig.com\/blog\/wp-json\/wp\/v2\/posts\/12307\/revisions\/12325"}],"wp:attachment":[{"href":"https:\/\/www.blopig.com\/blog\/wp-json\/wp\/v2\/media?parent=12307"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.blopig.com\/blog\/wp-json\/wp\/v2\/categories?post=12307"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.blopig.com\/blog\/wp-json\/wp\/v2\/tags?post=12307"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/www.blopig.com\/blog\/wp-json\/wp\/v2\/ppma_author?post=12307"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}My Experience…<\/h2>\n\n\n\n