Lead AI Automation Engineer

About the role

Digitain is looking for a Lead AI Automation Engineer to design and scale intelligent process‑automation solutions across its enterprise ecosystem. You will own the end‑to‑end architecture of AI‑driven pipelines that turn unstructured data into actionable business intelligence.

Key responsibilities

• Architect resilient, end‑to‑end automation pipelines that integrate Large Language Models (LLMs), Retrieval‑Augmented Generation (RAG) and custom AI tools with core systems.
• Lead large‑scale web‑scraping, API extraction and document‑processing strategies, handling anti‑bot measures and dynamic schemas.
• Develop sophisticated entity‑matching and semantic search solutions using vector databases and embedding models.
• Design, evaluate and optimise RAG frameworks to ground LLM responses in proprietary knowledge bases.
• Implement custom NLP pipelines (classification, NER, sentiment analysis, document parsing) for automated decision‑making and reporting.
• Establish best practices for exception handling, LLM output validation, latency optimisation and system monitoring.
• Mentor AI automation specialists, conduct code reviews and define SOPs for workflow documentation, API management and prompt engineering.
• Collaborate with cross‑functional leaders to identify high‑value automation opportunities and demonstrate ROI.

Required profile

• 5+ years of software, data‑engineering or process‑automation experience, with 2–3 years focused on AI/LLM‑powered automation.
• Proven track record delivering complex projects involving unstructured data, web‑scraping and NLP.
• Strong leadership and communication skills to align technical solutions with business goals.

Required skills

• Python
• Pandas
• Asyncio
• Playwright
• Selenium
• BeautifulSoup
• Scrapy
• FastHTML
• FastAPI
• LangChain
• LlamaIndex
• OpenAI API
• Anthropic
• Hugging Face
• Vector databases
• Embedding models