This half-day workshop is designed to provide participants with a practical understanding of the process of testing and evaluating large language models and related generative AI applications for use in a business context.
Key Information:
- Face-to-face Workshop
- Half-Day
- Workshop date: 10th of July, 12.30pm to 4.30pm
- Price: $500 ex-GST
Workshop Topics:
SESSION 1: Evaluating Large Language Models
⚡ Introduction to Large Language Models
Overview of LLMs, Key Characteristics of LLMs
⚡ Testing Large Language Models
Testing in LLM Development, Types of Tests, Test Case Design
⚡ Evaluation Metrics and Techniques
Common Metrics, Qualitative Evaluations, Challenges
⚡ Practical Exercise
Hands-on Exercise, Group Discussion
SESSION 2: Practical Techniques and Best Practices in LLM Testing
⚡ Advanced Testing Techniques
Uncovering Biases & Ensuring Fairness, Testing for Robustness, Scenario-based Testing
⚡ Optimizing LLMs Through Iterative Testing
Iterative Development, Feedback Loops, Case Studies
⚡ Best Practices and Future Directions
Best Practises, Emerging Trends, Ethical Considerations & Responsible AI
⚡ Interactive Session
Applying Advanced Testing Techniques
⚡ Wrap up
Key Takeaways, Resources, Conclusion
What's included?
🌀 Expert Workshops
Learn from leading industry experts in tech and business.
🌀 Interactive Sessions
Engage in interactive sessions that facilitate collaborative learning and discussion among participants.
🌀 Networking Opportunities
Connect with peers and industry who share a common interest in AI deployment and governance. Lunch will be provided at the beginning of the workshop.
Who is it for?
💡 This workshop is intended for technical practitioners and any professionals looking to understand the process of testing and evaluating LLMs and related generative AI applications for use in a business context.
Where is it delivered?
📍 The Precinct, 315 Brunswick St, Fortitude Valley QLD 4006 - Warra Room (Level 2)
Participants have to join in-person to attend the program.
More questions?
📭 There are only 20 seats available for this cohort.
Reach out to KJR at info@kjr.com.au if you have any questions.
This program is delivered by KJR. KJR is a founding member of the Queensland AI Hub.
KJR is an Australian Software Quality Engineering Consultancy and a leading practitioner in Responsible AI implementation. Founded on over 26 years of experience in quality assurance and verification, KJR has always understood the importance of managing IT risk and especially do so now with the steady maturation of various emerging technologies. We recognise the potential of Artificial Intelligence and Machine Learning and see the specific challenges these technologies pose to traditional forms of quality assurance. We have harnessed our expertise to develop practical approaches to assuring compliant and successful deployments of AI solutions.
