AI Prompt Engineer

Noodle | ZA | remote

Noodle is hiring a remote AI Prompt Engineer in South Africa with 2+ years of production LLM prompt-engineering experience, evaluation skills, RAG knowledge, observability experience, and basic JavaScript or Python.

Job description

Noodle is hiring an AI Prompt Engineer to design, test, evaluate, and continuously improve the prompts and system instructions that power AI agents across student enrollment, learning, and support use cases. The role translates educational and operational requirements into reliable agent behavior, builds prompt architectures for multi-step and RAG-augmented workflows, collaborates with engineering and university stakeholders on deployment, and creates evaluation frameworks for accuracy, tone, hallucination rate, task completion, and learning-objective alignment.

Requirements

  • 2+ years of experience designing and iterating prompts for LLM-powered applications in a production environment.
  • Deep familiarity with few-shot prompting, chain-of-thought, system vs. user roles, output-format constraints, tool-use prompting, and RAG integration.
  • Experience building and running prompt evaluations, including metric definition, test-case creation, result interpretation, and improvement decisions.
  • Strong written communication with the ability to write clearly, precisely, and persuasively.
  • Experience with LLM observability tools such as Langfuse, Weights & Biases, or similar.
  • Familiarity with LTI and how AI tools integrate with LMS platforms such as Moodle, Canvas, or Instructure.
  • Experience with voice agents or multimodal prompting.
  • Comfort reading and writing basic JavaScript or Python for prompt automation and testing pipelines.
  • Knowledge of OpenAI, Anthropic, or other model-provider APIs.
  • Ability to work across engineering, education, product, and university-stakeholder groups.
  • Ability to thrive in ambiguity and iterate quickly based on user feedback.
  • Must be legally authorized to live and work in South Africa and maintain South African residency throughout employment.

Skills

  • Prompt Engineering
  • LLM Evaluation
  • RAG
  • AI Agent Workflows
  • Langfuse / LLM Observability
  • JavaScript
  • Python
  • OpenAI / Anthropic APIs
  • LTI / LMS Integration
  • Moodle / Canvas / Instructure
  • Voice & Multimodal Prompting
  • Red Teaming & Adversarial Testing
  • Cross-functional Collaboration