Edge Agent Lab

Testing platform for on-device AI agents

What is this?

Edge Agent Lab is an Android testing platform for evaluating small language model (SLM) agents directly on mobile devices. It provides tools to test function calling capabilities, measure inference performance, and understand where edge AI succeeds and fails.

Built with JetBrains Koog for agent orchestration and Google's LiteRT-LM for on-device inference.

Test Endpoint

The app fetches test definitions from this URL:

GET https://edgeagentlab.dev/tests/tool_tests.json

Resources

GitHub Repository

Source code and documentation

Article: From Flat Notifications to Edge AI

The original prototype

Article: Tool Calling Research

Model conversion and testing

Test Definitions

View raw JSON test file

Roadmap WIP

Current: Static test JSON hosted here, fetched by the app.
Next: Web-based test editor for creating custom evaluation scenarios.
Later: Performance tracking and visualization across devices.