GenAI Prompt Engineering

Latitude
Latitude

New York County, NY, USA · Jersey City, NJ, USA · Morris County, NJ, USA · New York, NY, USA

Posted on Nov 6, 2026

We are seeking an experienced GenAI Prompt Engineer to design, develop, test, and optimize prompts for LLM-powered chatbots, AI agents, and Retrieval-Augmented Generation (RAG) systems.

The candidate will translate business requirements into reliable prompt and agent workflows while ensuring accuracy, consistency, security, and measurable performance improvements.

Key Responsibilities:

  • Design, test, and refine prompts to maximize accuracy, relevance, and consistency.
  • Build evaluation frameworks, including A/B testing, benchmarking, golden datasets, and rubric-based scoring.
  • Apply strong knowledge of LLM behavior, context windows, tokenization, and fine-tuning versus prompting.
  • Collaborate with product, engineering, and data science teams to design prompt and agent workflows.
  • Implement prompt security and safety measures, including jailbreak prevention, bias mitigation, and guardrails.
  • Maintain prompt versioning, regression testing, and continuous optimization.

Required Qualifications & Technical Skills:

  • 5+ years of experience in Software, Data, or Applied AI roles.
  • Minimum 1+ year of hands-on LLM prompt engineering experience in production.
  • Strong Python scripting and API integration experience.
  • Hands-on experience with GPT and Claude.
  • Experience with LLM orchestration tools such as LangChain.
  • Experience designing evaluation frameworks and improving LLM performance.
  • Working knowledge of RAG architectures and AI agent patterns.
  • Experience with tool calling and agent workflows.
  • Strong data analysis skills to interpret evaluation results.