AI Service Level Optimization Specialist vs AI Skills Assessment Designer

A AI Service Level Optimization Specialist Only

• Defining and operationalizing SLOs/SLIs/SLAs for non-deterministic AI systems
• Prompt engineering and prompt chain optimization for quality and latency
• RAG pipeline tuning - chunking strategies, embedding model selection, reranking
• Statistical evaluation of LLM outputs (BLEU, ROUGE, LLM-as-judge, human eval correlation)
• Real-time monitoring and alerting for AI inference pipelines
• A/B testing and canary deployment methodologies for model and prompt changes
• Customer journey mapping and friction point identification in AI-mediated experiences
• Cost-performance tradeoff analysis across model providers and deployment architectures