GenAI Prompt Engineering
New York County, NY, USA · Jersey City, NJ, USA · Morris County, NJ, USA · New York, NY, USA
Posted on Nov 6, 2026
We are seeking an experienced GenAI Prompt Engineer to design, develop, test, and optimize prompts for LLM-powered chatbots, AI agents, and Retrieval-Augmented Generation (RAG) systems.
The candidate will translate business requirements into reliable prompt and agent workflows while ensuring accuracy, consistency, security, and measurable performance improvements.
Key Responsibilities:
- Design, test, and refine prompts to maximize accuracy, relevance, and consistency.
- Build evaluation frameworks, including A/B testing, benchmarking, golden datasets, and rubric-based scoring.
- Apply strong knowledge of LLM behavior, context windows, tokenization, and fine-tuning versus prompting.
- Collaborate with product, engineering, and data science teams to design prompt and agent workflows.
- Implement prompt security and safety measures, including jailbreak prevention, bias mitigation, and guardrails.
- Maintain prompt versioning, regression testing, and continuous optimization.
Required Qualifications & Technical Skills:
- 5+ years of experience in Software, Data, or Applied AI roles.
- Minimum 1+ year of hands-on LLM prompt engineering experience in production.
- Strong Python scripting and API integration experience.
- Hands-on experience with GPT and Claude.
- Experience with LLM orchestration tools such as LangChain.
- Experience designing evaluation frameworks and improving LLM performance.
- Working knowledge of RAG architectures and AI agent patterns.
- Experience with tool calling and agent workflows.
- Strong data analysis skills to interpret evaluation results.