Senior Prompt Engineer, NYC

About the position Are you ready to make an impact? West Monroe is seeking an innovative and detail-oriented Senior Prompt Engineer to support use case development for an Agentic AI platform on Google Cloud Platform (GCP). This role will focus on preparing and structuring input data and context, designing and refining prompts and schemas, and tuning extraction and reasoning behavior to ensure the AI agent produces accurate, consistent, and auditable outputs.

Responsibilities

• Collect, curate, and structure input data and contextual information required for the AI agent to perform effectively.
• Develop strategies to optimize the quality and relevance of input data, ensuring it aligns with specific use case requirements.
• Collaborate with data engineers and domain experts to ensure data sources are clean, consistent, and appropriately formatted for use in AI prompts.
• Design, test, and refine prompts and schemas to guide the AI agent's behavior and outputs.
• Create modular and reusable prompt templates that can be adapted across different use cases.
• Work closely with solution architects and stakeholders to align prompts with business goals and desired outcomes.
• Experiment with various prompt structures, wording, and configurations to achieve optimal agent performance.
• Fine-tune the AI agent's extraction and reasoning capabilities to ensure outputs are accurate, consistent, and aligned with expectations.
• Develop strategies for improving the agent's ability to handle ambiguity, incomplete data, and complex reasoning tasks.
• Use feedback loops and iterative testing to continuously improve the agent's performance and reliability.
• Ensure outputs are auditable, providing clear traceability of how the agent arrived at its conclusions.
• Conduct rigorous testing of prompts and agent behavior to identify and resolve issues such as bias, inconsistencies, or inaccuracies.
• Develop automated testing frameworks to validate the agent's outputs across various scenarios and edge cases.
• Document findings and provide actionable recommendations to improve the agent's performance.
• Collaborate with cross-functional teams, including data scientists, engineers, and business stakeholders, to align on use case requirements and objectives.
• Act as a subject matter expert on prompt engineering and provide guidance on best practices for leveraging AI agents.
• Communicate results, challenges, and improvements to technical and non-technical audiences.

Requirements

• Prompt Engineering: Strong experience designing, refining & optimizing prompts & system instructions for large language models (e.g., GPT, PaLM, or similar) to drive reliable reasoning and task performance.
• Context Design & Patterns: Expertise in structuring & managing context using patterns such as RAG, prompt chaining, memory windows & schema-driven context alignment.
• AI/ML & NLP Foundations: Strong understanding of NLP, reasoning models & LLM behavior to inform prompt strategy and failure mitigation.
• Data Structuring & Preprocessing: Expertise in preparing and transforming input data, including text preprocessing, schema design, and grounding strategies
• Google Cloud Platform (GCP): Experience with GCP services such as Vertex AI, BigQuery, and related GCP AI/ML services to deploy and evaluate prompt-driven systems.
• Programming & Automation Skills: Proficiency in Python or similar programming languages for prototyping, testing, evaluation harnesses and prompt automation.
• Requirement to be onsite in New York City hybrid.
• Strong analytical and problem-solving skills to fine-tune agent behavior and resolve inconsistencies.
• Experience with testing frameworks and methodologies to validate AI outputs across diverse scenarios.
• Ability to identify and mitigate issues related to bias, ambiguity, or incomplete reasoning in AI agents.
• Excellent communication skills to explain technical concepts and results to both technical and non-technical stakeholders.
• Proven ability to work collaboratively in cross-functional teams, including data scientists, engineers, and business users.
• Strong documentation skills to ensure transparency and reproducibility of prompt engineering processes.

Nice-to-haves

• Experience working with large language models (LLMs) such as OpenAI's GPT, Google’s PaLM, or similar.
• Familiarity with MLOps practices and tools for managing the AI lifecycle.
• Knowledge of ethical AI principles and techniques for ensuring fairness, transparency, and accountability.
• Google Cloud certifications (e.g., Professional Machine Learning Engineer, Professional Data Engineer).

Benefits

• Employees (and their families) are covered by medical, dental, vision, and basic life insurance.
• Employees are able to enroll in our company’s 401k plan, purchase shares from our employee stock ownership program and be eligible to receive annual bonuses.
• Employees will also receive unlimited flexible time off and ten paid holidays throughout the calendar year.
• Eligibility for ten weeks of paid parental leave will also be available upon hire date.

Apply tot his job Apply To this Job