AIL Project
AIL Project is an open source framework to collect, crawl, process and analyse unstructured data from the clear web, Tor, and modern communication platforms.
What is AIL Project?
AIL Project is a modular intelligence and leak-analysis platform. It helps analysts ingest diverse sources, extract meaningful indicators, and correlate findings across technical, textual and visual artifacts.
AIL includes an extensible Python-based framework, an advanced Lacus crawler manager, and dedicated feeder integrations for Discord, Telegram and other stream providers.
From leak detection and retro-hunting to investigations and external integrations, AIL is designed to support day-to-day intelligence, CTI and SOC workflows at scale.
Broad Data Collection
Collect from web/Tor/I2P crawling, external feeds, and chat platforms. AIL supports ongoing ingestion and reprocessing so teams can continuously enrich old and new data.
Deep Analysis & Correlation
Extract credentials, emails, crypto artifacts, files, keys, and more. Use full-text indexing, YARA-based detections, OCR/QR extraction, and graph-based correlation to accelerate investigations.
What's New in Recent Releases
AIL is actively developed with frequent feature releases. Recent additions include:
- Unified search interface with best-match and most-recent ranking.
- Chat Explorer improvements for Discord, Telegram, and Matrix metadata/threads.
- Built-in YARA rule editor and expanded retro-hunting workflows.
- Image/screenshot intelligence enhancements with AI-assisted descriptions.
- Expanded OCR and QR extraction, including inverted QR code handling.
- Full PDF processing pipeline with metadata extraction and translation support.
- Passive SSH correlation for deanonymization and infrastructure analysis.
- I2P crawling support and improved crawler stability.
- Investigation workflow upgrades and stronger organization-aware access control.
- Extended mail and username search with improved performance and pagination.
Free and Open Source by Design
AIL is free and open source, CLA-free, and built for collaboration. Contributions are welcome across modules, integrations, detections, and workflows.