Prompt Engineer
New York, NY, USA
Posted on Oct 16, 2026
Job Requirements
Having 8+ years of experience on the following:
Prompt Design & Optimization – Craft, test, and refine prompts for LLMs to maximize accuracy, relevance, and consistency across use cases (chatbots, agents, RAG systems).
Evaluation & Experimentation – Design evaluation frameworks (A/B testing, benchmarking, rubric-based scoring) to measure prompt performance and iterate systematically.
LLM & Tooling Expertise – Deep understanding of LLM behavior (GPT, Claude, etc.), context windows, tokenization, fine-tuning vs. prompting trade-offs, and frameworks like LangChain or similar orchestration tools.
Cross-functional Collaboration – Work closely with product, engineering, and data science teams to translate business requirements into effective prompt/agent workflows.
Technical & Analytical Skills – Strong Python scripting, API integration, data analysis, and familiarity with prompt security/safety practices (jailbreak prevention, bias mitigation, guardrails).
Work Experience
10-15Years
Having 8+ years of experience on the following:
Prompt Design & Optimization – Craft, test, and refine prompts for LLMs to maximize accuracy, relevance, and consistency across use cases (chatbots, agents, RAG systems).
Evaluation & Experimentation – Design evaluation frameworks (A/B testing, benchmarking, rubric-based scoring) to measure prompt performance and iterate systematically.
LLM & Tooling Expertise – Deep understanding of LLM behavior (GPT, Claude, etc.), context windows, tokenization, fine-tuning vs. prompting trade-offs, and frameworks like LangChain or similar orchestration tools.
Cross-functional Collaboration – Work closely with product, engineering, and data science teams to translate business requirements into effective prompt/agent workflows.
Technical & Analytical Skills – Strong Python scripting, API integration, data analysis, and familiarity with prompt security/safety practices (jailbreak prevention, bias mitigation, guardrails).
Work Experience
10-15Years