How to become an AI Engineer

Ideal starting backgrounds

You're ready to start this path if you can:

• Write production Python (error handling, logging, testing)
• Understand basic machine learning concepts
• Use APIs and integrate third-party services (OpenAI, etc.)
• Work with Git and understand CI/CD basics
• Have some familiarity with databases and APIs

Not ready yet? Start with Python for Everybody (free) or Data Engineer foundation (CP41 Stage 1) first.

Study hours required: ~400–500 hours total. Assumes 12 hours/week = 24 months.

All figures: median base salary, not including bonuses/equity. ZAR = USD × 18. Sources: Robert Half 2026, Levels.fyi, AngelList Salaries.

South Africa note: AI Engineers are the highest-paid data/AI role due to rarity and demand. Remote roles for international companies: R90,000–R140,000/month for entry, R150,000–R220,000/month for mid-level. Local Johannesburg roles at FinTech/Takealot: R80,000–R120,000/month for entry. Remote is strongly recommended for SA AI engineers.

Salary accelerators: AWS + Azure + GCP certs, LangChain/vector DB expertise, LLM fine-tuning knowledge, and RAG pipeline experience all command 20–30% premiums.

Month 0–3: Build the AI Foundation

1. Master LLM fundamentals — Complete DeepLearning.AI short courses (free, 1–2 hours each). Do all of them.
2. Learn prompt engineering — Experiment with OpenAI/Claude APIs. Build 5 prompt engineering projects.
3. Understand RAG — Read about retrieval-augmented generation. Build a simple RAG system with LangChain and Pinecone (free tier).
4. Join communities — r/OpenAI, r/LocalLLM, LangChain Discord, AI engineer Discord communities.
5. Stay updated — Subscribe to Import AI newsletter and The Batch for AI news.

Month 3–9: Build Your AI Portfolio

• Project 1: RAG Chatbot — Build a Q&A system that retrieves documents and uses an LLM to answer questions. Use LangChain, Pinecone/Weaviate, and OpenAI/Claude API. Include: document loading, embedding, retrieval, answer generation. Estimated time: 16 hours.
• Project 2: Fine-tuned Model — Fine-tune a smaller LLM (Llama, Mistral) on custom data (your choice). Deploy as an API. Monitor for quality. Estimated time: 12 hours.
• Project 3: Production AI App — Deploy one of your projects to production (AWS Lambda, Azure Functions, Hugging Face Spaces). Set up monitoring for hallucinations, latency, cost. Estimated time: 10 hours.

Month 9–18: Pursue Certifications

• AWS AIF-C01: Study 4–6 weeks. Use Stephane Maarek's course + hands-on labs.
• Microsoft AI-102: Study 6–8 weeks. Use Microsoft Learn.
• Build GitHub visibility: Push all projects. Write blog posts explaining RAG, prompt engineering, fine-tuning. Share on LinkedIn.

Month 18–24: Apply & Iterate

• CV positioning: List as "AI Engineer" once you have certs + portfolio. Highlight LLMs, RAG, fine-tuning, prompt engineering.
• Target companies: OpenAI, Anthropic, Hugging Face (if international openings), tech companies (Stripe, Discord, GitHub), FinTech (Capitec, Luno), startups. Remote is norm.
• Interview prep: Be ready to discuss 1) Your RAG system and how you engineered it, 2) Prompt engineering techniques, 3) LLM fine-tuning approaches, 4) Handling hallucinations, 5) Cost optimization for LLM inference.
• Salary negotiation: AI engineers are hot. Entry-level remote roles often start at R80k–R120k/month; negotiate up to R100k–R140k.

AI Engineer at Capitec (Johannesburg) — Junior Level

08:00 — Standup with the product team. You're building a customer support chatbot using Claude. Yesterday's deployment had hallucinations (making up account details). Review logs and user feedback.

09:00 — Analyze the issue. The RAG context retrieval was missing some customer details. Update the vector database with more customer context. Test with sample queries.

10:00 — Refine the prompt. Add guardrails: "If you don't find the information in the knowledge base, say you don't know." Test the updated system. Better—fewer hallucinations.

11:00 — Deploy new version to staging. Run 100 test queries. Monitor for quality. Metrics improve: hallucination rate drops from 8% to 2%.

12:00 — Code review with a senior engineer. Feedback: add more guardrails, implement cost monitoring for API calls, and add logging for debugging. You implement.

13:00 — Lunch.

14:00 — Performance optimization. Claude API calls are expensive. Implement semantic caching: if the same query comes in twice, use the cached response. Reduces costs by 30%.

15:00 — Documentation. Write a runbook for the support team: how the chatbot works, when to escalate to humans, how to provide feedback for improvement.

16:00 — Help product team with prompt iteration. They want the chatbot to be more friendly. Test different system prompts. Find one that feels better without sacrificing accuracy.

17:00 — End of day. Deploy new version to production. All metrics green. Plan: start AWS AIF-C01 exam prep tomorrow.

AI Engineer at an OpenAI Partner (Remote/Cape Town) — Mid Level

09:00 — Async standup. You're leading the fine-tuning project—training a custom model on customer support interactions to specialize in your company's product.

09:30 — Review training results from overnight run. Model loss decreased nicely. Evaluate on test set: accuracy is 94%, up from 88% (base model). Good progress.

10:00 — Start the second phase: reduce hallucination rate. Implement constitutional AI approach—use the base model to critique outputs, filter bad ones, retrain. Set up the pipeline.

11:30 — Pair programming with a junior engineer on cost optimization. We're spending $5k/week on API calls. Implement semantic caching, batching, and cheaper model selection where possible. Goal: 30% cost reduction.

13:00 — Lunch.

14:00 — Troubleshoot a production issue. A recent prompt change caused the system to be too conservative—it's now refusing valid requests. Investigate, tweak the guardrails, retest. Deploy fix.

15:00 — Meet with the product team. They want AI features in 3 new product areas. Scope the work: RAG for 2, fine-tuning for 1. Estimate effort and timeline. Propose a phased approach.

16:00 — Document your fine-tuning process. Create a template so other teams can fine-tune models. Include: data preparation, training, evaluation, deployment.

16:30 — Respond to PR comments from the team. One engineer is asking about handling streaming responses. Explain the approach, review their code, approve.

17:00 — Start on Google Cloud Professional ML Engineer cert. You're aiming for multi-cloud knowledge. End of day.

Market specifics

AI engineers are the hottest role in South African tech in 2026. Capitec, Luno, and PayFast are hiring aggressively for customer support and fraud detection AI. Takealot and Shoprite are building recommendation AI. Traditional banks (Nedbank, ABSA) are slower to adopt but moving. Most SA AI engineers work remotely for international AI companies (OpenAI partners, Anthropic, Hugging Face, startups in UK/US) at significantly higher pay.

LLM adoption is mainstream in South African tech. Every startup and forward-thinking company wants AI features. The skillset is globally valuable; remote-first job search is essential.

AI engineer is the most accessible entry to AI careers—lower barrier than AI researcher (no PhD required) and more accessible than traditional ML engineer. This is the fastest path to high salary in data/AI.

SA-specific resources

Q: Do I need a degree to become an AI Engineer?

No. Most AI engineers in 2026 are self-taught or come from software engineering backgrounds. Hands-on experience with LLMs matters more than credentials.

Q: Should I start with traditional ML or go straight to LLMs/AI?

Go straight to LLMs if you have engineering background. LLMs are newer and more applied; traditional ML is still valuable but slower path. You can layer ML knowledge later.

Q: How long does it take from zero?

18–24 months if starting from software engineering background. 24–36 months if starting from scratch. This is a fast path compared to traditional ML engineer (which takes 24–36 months).

Q: Is AWS AIF-C01 worth it?

Yes. It's new (2024), covers current GenAI landscape, and shows you understand AWS's AI services. Start with this, then move to Azure/GCP if multi-cloud interests you.

Q: What's the difference between AI Engineer and ML Engineer?

ML Engineer = traditional machine learning (regression, classification, neural networks). AI Engineer = LLMs, prompt engineering, RAG, generative AI. AI engineer is newer and more focused on LLMs. Different skill sets but overlapping fundamentals.

Q: Can I do this path while working as a software engineer?

Yes, ideal actually. Use your engineering skills and upskill on AI/LLMs on nights and weekends. Many software engineers transition to AI engineer this way in 12–18 months.

Template version: 2026-05-02 | Maintained by IT Career Roadmap | ZAR baseline: R18/$1 USD File naming: Career_Paths/CP46_Data_AI_Engineer.md