Prompt / LLM Engineer

Latitude
Latitude

Software Engineering, Data Science

Hyderabad, Telangana, India

Posted on Jun 9, 2026
About LetitbexAI

LetitbexAI is a fast-growing AI-driven technology company focused on building intelligent, scalable, and enterprise-grade solutions. We work at the intersection of AI, data engineering, cloud, and business transformation, helping organizations unlock real value from artificial intelligence.

Position: Prompt / LLM Engineer

Experience: 3-5 Years

Notice Period: Can be considered up 15 Days

Role Summary

Specialize in designing, optimizing, and evaluating prompts for LLMs in various products. Build frameworks for systematic prompt engineering and ensure high-quality LLM outputs for various tasks.

Key Responsibilities

  • Design and optimize prompts for LLM-based tasks related to various products.
  • Conduct systematic experimentation to evaluate prompt performance and quality
  • Implement prompt versioning and A/B testing frameworks
  • Build evaluation rubrics and quality metrics for LLM outputs
  • Implement Retrieval Augmented Generation (RAG) patterns for contextual accuracy
  • Collaborate with product and engineering teams on LLM integration and deployment
  • Document prompt strategies, patterns, and best practices
  • Research and evaluate new LLM models and APIs for applications to be developed
  • Manage cost optimization and latency improvements for LLM usage

Required Skills & Experience

  • 3-5 years of experience in AI/ML engineering or AI product development
  • Deep hands-on experience with LLMs (GPT-4, Claude, LLaMA, etc.)
  • Strong understanding of prompt engineering techniques and evaluation methodologies
  • Experience with LLM APIs and integration patterns
  • Knowledge of NLP concepts and language models
  • Proficiency in Python and ability to work with code-based prompting frameworks
  • Strong analytical skills and attention to quality
  • Excellent communication and documentation skills

Nice to Have

  • Experience with RAG systems and vector databases
  • Knowledge of fine-tuning LLMs for specific domains
  • Experience in HR tech domain & Vendor Management Systems
  • Published research or case studies on prompt engineering
  • Experience with LangChain, LlamaIndex, or similar frameworks