Connecting to a local LLM with Ollama

Run a local language model with Ollama and connect Mundi for offline, free Artificial Intelligence-powered geospatial analysis on your laptop.

Mundi is an open source web GIS that can connect to local language models via Ollama, enabling offline, free use of Artificial Intelligence features without data leaving your machine. The project is compatible with the Chat Completions API that Ollama exposes, so Mundi can talk to models such as gemma3-tools. The guide demonstrates running gemma3-1b on a MacBook Pro with an M1 Pro chip, a lightweight model that can run quickly on a laptop and fit within modest disk and memory constraints.

Preparation requires a self-hosted Mundi instance built with Docker Compose, Ollama installed on the host, and at least one Ollama model downloaded. The tutorial uses orieg/gemma3-tools:1b as an example because it supports tool calling. To wire Mundi to the local server, edit docker-compose.yml and set environment variables such as OPENAI_BASE_URL to http://host.docker.internal:11434/v1, OPENAI_API_KEY to a non-empty string like ollama, and OPENAI_MODEL to the model name. Adding extra_hosts with host.docker.internal mapped to host-gateway ensures the container can reach services on the host at the Ollama default port.

After saving configuration changes, start the Ollama server on the host with ollama serve and, if needed, launch the model with ollama run orieg/gemma3-tools:1b. Then bring up the Mundi application using docker compose up app from the mundi.ai project directory. Once migrations complete and services report ready, open http://localhost:8000 to access Mundi and its assistant, Kue. Upload a GIS file such as a GeoPackage and ask Kue about your layer; Kue will use the local model to summarize layer type, geometry, feature count, and more, and can invoke tools if the model supports tool calling.

The documentation also emphasizes caution: local 1B-parameter models will often give useful, concise summaries but may hallucinate details or misinterpret data relationships, as shown in an example where the model incorrectly suggested a PostGIS connection for a standalone vector file. Users should verify outputs and treat model responses as aids rather than authoritative answers.

70

Impact Score

How Artificial Intelligence is reshaping financial services oversight

Financial services regulators are largely treating Artificial Intelligence as another technology governed by existing rules rather than building new securities-specific frameworks. History suggests that clearer expectations will emerge through examinations, enforcement, and supervisory guidance.

Nvidia faces gamer backlash over Artificial Intelligence shift

Nvidia is facing growing frustration from gamers as memory supply is steered toward data center chips and DLSS 5 becomes more central to game performance. The dispute highlights how far the company’s priorities have shifted toward enterprise Artificial Intelligence.

Executives see limited Artificial Intelligence productivity gains so far

Corporate enthusiasm around Artificial Intelligence has yet to translate into broad gains in employment or productivity, reviving comparisons to the long lag between early computing breakthroughs and measurable economic impact. Recent surveys and studies show mixed results, with strong expectations for future benefits but little consensus on present gains.

Nvidia skips a new GeForce generation as Artificial Intelligence chips dominate

Nvidia is set to go a year without a new GeForce GPU generation for the first time since the 1990s as memory shortages and higher margins in Artificial Intelligence hardware reshape the market. AMD and Intel are also struggling to capitalize because the same supply constraints are hitting gaming products across the industry.

Where gpu debt starts to break

Stress in gpu-backed infrastructure financing is emerging around deals that lack the structural protections seen in the strongest transactions. Oracle, the Abilene Stargate project, and older CoreWeave debt illustrate different ways residual risk can surface when contracts, collateral, and counterparties fall short.

Contact Us

Got questions? Use the form to contact us.

Contact Form

Clicking next sends a verification code to your email. After verifying, you can enter your message.