Large Language Models can run tools in your terminal with LLM 0.26

LLM 0.26 introduces powerful tool support, enabling Large Language Models to execute custom Python functions and plugin tools directly from the terminal or Python library. This brings unprecedented extensibility to modern Artificial Intelligence workflows.

The release of LLM 0.26 represents a major advancement in Large Language Model (LLM) development, introducing full support for tools that allow models to execute Python functions and plugin-based utilities directly from the command-line interface (CLI) or Python library. Users can now grant models from OpenAI, Anthropic, Gemini, and local offerings like Ollama access to any capability expressible as a Python function, bridging a critical gap between language models and bespoke computational tasks.

Key features include the ability to install tool plugins that enhance model capabilities across supported providers, the use of the --tool or -T options for direct tool invocation, and the flexibility to pass ad-hoc Python functions via the --functions flag. Tools operate seamlessly in both synchronous and asynchronous contexts. Python API enhancements mirror CLI improvements, supporting complex tool interactions, including stepwise ‘chain’ execution where models can request and iterate through tool calls to reach a final answer. Example use cases range from simple version checks and time lookups to advanced mathematical evaluation, JavaScript execution, and direct SQL queries—offered through dedicated plugins like llm-tools-simpleeval, llm-tools-quickjs, llm-tools-sqlite, and llm-tools-datasette.

LLM 0.26’s architecture abstracts tool use across a rapidly maturing ecosystem, aligning with advances such as Model Context Protocol (MCP) for interoperability. Model vendors, including OpenAI, Anthropic, Google, and Mistral, now universally support function calling and tool usage patterns, making this release particularly timely. The changelog highlights contributions like improved plugin documentation, enhanced logging, and the ability for the Python API to handle both ‘single tool’ and ‘toolbox’ constructs. The project’s roadmap includes support for more plugin types, better interfaces for tool execution logs, and full MCP client integration. This major release positions LLM as a flexible, model-agnostic platform for users and developers to easily extend the capabilities of modern language models, fostering innovation across Artificial Intelligence-driven workflows.

72

Impact Score

IBM and AMD partner on quantum-centric supercomputing

IBM and AMD announced plans to develop quantum-centric supercomputing architectures that combine quantum computers with high-performance computing to create scalable, open-source platforms. The collaboration leverages IBM´s work on quantum computers and software and AMD´s expertise in high-performance computing and Artificial Intelligence accelerators.

Qualcomm launches Dragonwing Q-6690 with integrated RFID and Artificial Intelligence

Qualcomm announced the Dragonwing Q-6690, billed as the world’s first enterprise mobile processor with fully integrated UHF RFID and built-in 5G, Wi-Fi 7, Bluetooth 6.0, ultra-wideband and Artificial Intelligence capabilities. The platform is aimed at rugged handhelds, point-of-sale systems and smart kiosks and offers software-configurable feature packs that can be upgraded over the air.

Recent books from the MIT community

A roundup of new titles from the MIT community, including Empire of Artificial Intelligence, a critical look at Sam Altman’s OpenAI, and Data, Systems, and Society, a textbook on harnessing Artificial Intelligence for societal good.

Contact Us

Got questions? Use the form to contact us.

Contact Form

Clicking next sends a verification code to your email. After verifying, you can enter your message.