Over the holidays when I had some time off, I pondered the thought of how to make some passive income. In this day and age of AI and all the hype, I had been thinking that the world is my oyster. With the threat of AI taking over the world, especially in my day to … Read more
JetBrains has announced that its code completion LLM, Mellum, is now available on Hugging Face as an open source model. According to the company, Mellum is a “focal model,” meaning that it was built purposely for a specific task, rather than trying to be good at everything. “It’s designed to do one thing really well: … Read more
In a previous article, we explored how to use Ollama and DeepSeek-R1 with SingleStore for a simple example. In this article, we’ll build on that example by working with a PDF document from the internet. We’ll store the document and its vector embeddings in SingleStore, then use DeepSeek-R1 to identify blockchain investment opportunities. The notebook … Read more
If you’re a Java developer wanting to build AI agents or interface with various large language models (LLM) in Java, you will be familiar with Langchain4J. What Is Langchain4J Simplified? LangChain4J is essentially a toolbox for Java developers that makes it easier to add advanced language AI capabilities (like chatbots or text generators) to their … Read more
Kong has announced updates to its AI Gateway, a platform for governance and security of LLMs and other AI resources. One of the new features in AI Gateway 3.10 is a RAG Injector to reduce LLM hallucinations by automatically querying the vector database and inserting relevant data to ensure the LLM is augmenting the results … Read more
Blog / SEO Industry News / Grok 3 and ChatGPT showdown: Is Musk’s new AI really the best LLM on Earth? The short answer? Probably not. Things are ramping up quick in the AI world, which means we need to look beyond just Grok 3 and ChatGPT to see the full picture. When Elon Musk launched … Read more
This post gets you started with the new Gemma 3 model for on-device inference. Giving you the simplest steps to get started with AI on Android. Gemma 3 1B is a new model size in the Gemma family of open weight models. When deploying small language models (SLMs) in production settings, models need to be small … Read more
Exo supports LLaMA, Mistral, LlaVA, Qwen, and DeepSeek Can run on Linux, macOS, Android, and iOS, but not Windows AI models needing 16GB RAM can run on two 8GB laptops Running large language models (LLMs) typically requires expensive, high-performance hardware with substantial memory and GPU power. However, Exo software now looks to offer an alternative … Read more
Compiling Large Language Models (LLMs) for Android devices using llama.cpp enables on-device inference, enhancing privacy and reducing latency. This tutorial provides a step-by-step guide to building and running LLMs on Android, leveraging the llama.cpp project. Llama architecture explain by Umar Jamil Prerequisites Android Device or Simulator: Ensure your device runs Android 7.0 (Nougat) or higher. … Read more
In recent years, the advancements in Large Language Models (LLMs) have transformed the landscape of artificial intelligence, enabling powerful applications across various domains. Among the many innovations in this realm, the DeepSeek R1 model stands out, offering remarkable capabilities in natural language processing and comprehension. This article delves into the intricacies of deploying the DeepSeek … Read more