Python and basic data-science skills (IBM lists Python, data analysis and data science)
An IBM Cloud account with a watsonx.ai trial or Lite plan for Prompt Lab, Tuning Studio and deployments
IBM assumes 6–12 months of hands-on watsonx experience, so plan extra lab time if you are new to it
Week 1 · 10 h
Solution design and prompt engineering
Match a use case to a model family on watsonx.ai (Granite, Llama, Mistral and others) by task, context length, licence and cost
Explain LLM limits (hallucination, context limits, bias) and when GenAI is the wrong tool
Use Prompt Lab in chat, structured and freeform modes, and tune decoding (greedy vs sampling, temperature, top-k/top-p, repetition penalty, stop sequences)
Save and reuse prompt templates with variables, and evaluate prompts with watsonx.governance metrics
Hands-on: In watsonx.ai Prompt Lab, build an extraction prompt for support emails. Compare greedy and sampling decoding on 10 examples, save it as a prompt template with a variable, and export the Python code.
Choose between prompt engineering, prompt tuning and fine-tuning, and explain parameter-efficient methods (LoRA, prompt tuning)
Prepare training data in the JSONL input/output format, set epochs, learning rate and batch size in Tuning Studio, and read the loss curve
Explain InstructLab's taxonomy-driven synthetic data generation and how it differs from classic fine-tuning
Deploy and test a tuned model, then compare it against the base model
Hands-on: Prepare 100+ labelled JSONL examples for a classification task, run a tuning experiment in Tuning Studio, deploy the tuned model, and compare its accuracy with the zero-shot base model on 20 held-out examples.