AI Integration Engineer

About the job

The AI Integration Engineer builds the connective tissue between LLM APIs, existing product systems, and end users. They are not training models. They are integrating, orchestrating, and deploying AI capabilities into production software, reliably, securely, and at scale.

Key Responsibilities:

● Integrate LLM APIs (Anthropic Claude, OpenAI GPT-4o, AWS Bedrock, Google

Gemini) into backend services and user-facing products

● Design and implement RAG pipelines: document ingestion, chunking strategy,

vector store selection, retrieval tuning

● Build agentic workflows using frameworks such as AgentCore, LangChain,

LlamaIndex, or custom orchestration patterns

● Manage prompt engineering, prompt versioning, and prompt evaluation

frameworks

● Implement guardrails for LLM outputs: validation, content filtering, fallback logic

● Monitor AI system performance: latency, cost-per-query, accuracy drift, token

usage

● Collaborate with frontend engineers to surface AI capabilities in product UIs

● Own the AI integration layer in the SDLC, from spec to CI/CD to production

observability

• 3+ years backend or full-stack experience; strong API design and consumption skills
• Proven experience integrating LLM APIs (any major provider) into production applications, not just prototypes
• Proficiency in Python and/or TypeScript/Node.js
• Hands-on experience with RAG: vector databases (Pinecone, Weaviate, pgvector etc), embedding models, chunking strategies.
• Understanding of prompt engineering: system prompts, few-shot examples, chain-of-thought, structured output
• Solid grasp of API security, rate limiting, cost management for LLM-based services
• Experience with AWS or another major cloud platform

Desirable Skills:

• Experience with agentic frameworks: AgentCore, LangChain, LlamaIndex,CrewAI, AutoGen, or similar
• Familiarity with multi-modal AI (vision, audio) or function calling / tool use
• Understanding of fine-tuning workflows even if not hands-on
• Experience using AI coding assistants to accelerate their own development workflow

🌞 Life at Leapfrog:

• Work with talented engineers and remarkable professionals in Nepal, the US and Europe, building state-of-the-art digital health products.
• Have an amazing career growth plan with support from experienced mentors and unlimited learning opportunities.
• Be a part of an experienced team—apply the best industry practices, get mentored by experienced professionals and be ready to mentor the new ones.
• Get exposure to clients who are leading entrepreneurs and startups from Silicon Valley.
• Your work will be at the cutting edge of healthcare innovation and make a difference in the lives of thousands of people worldwide.
• You will get the flexibility to work remotely or in the office— we value accountable freedom.
• Get growth opportunities, not just in your work. We organize various internal initiatives where you can be a part of a bigger learning community with webinars, Knowledge Sharing Sessions (KSS), and internal conferences.
• Be a part of a safe workplace where it’s okay to fail fast, get constructive feedback and grow as you move ahead.
• Get recognized for your work and all the changes you will make. We always look for, NO, create opportunities to celebrate efforts, play games, and have fun together!
• You will have a lot of fun at Leapfrog, there’ll never be a dull day.

🎁 Benefits and perks:

We believe our people are our greatest strength. With perks and benefits, we intend to offer everything our people need to do their best while maintaining a healthy balance between work and personal life.

Daily Work Support

🏠 Hybrid work: Work from office or home, depending on our flexible roster

💻 Support for resources: Receive a monthly internet and laptop allowance, and request resources for convenient WFH.

📆 5-day workweek: Enjoy weekends off and return refreshed on Mondays.

🍔 Food: Access to healthy meals while on-site.

Professional Growth

📚 'Growth mindset' fund: Investment in your post-grad degree, learning opportunities, and career growth.

👶 Child scholarship: Scholarships for your child in selected schools.

📈 Bi-annual bonus: Get timely festival and company bonuses.

Work/Life Balance

✈️ Paid time-offs: Annual, sick, well-being, and bereavement leaves.

🍼 Maternity leave: 3 months of paid leave, 1 month of unpaid leave, and 90 days of reduced workload.

🐣 Paternity leave: 15 days of paid paternity leave and 30 days work from home option after that.

💊 Menstruation leave: 6 days of paid menstruation leave annually.

We take care of you

🌿 Your well-being: Company-funded counseling services from certified therapists as well as COVID care services.

💰 Retirement fund: Social security fund with health and accidental insurance.

💸 Bank loan for eligible employees: Access bank loans processing through our partner banks.

Celebrating your efforts

🎉 Engagement and Events: Team lunch/dinner, company outings, and festival celebrations with your favorite co-workers!

😎 Exposure: Visit and work in the States and build better client rapport.

💖 Recognition: In-house awards, appreciation platforms, and benefits at key tenure years.