20 November 2023
5 min
Technical Architect
You would have to be living under the proverbial rock to not have seen the hype around AI in recent years. Satya Nadella, Microsoft CEO, describes it as a tidal wave as big as the internet, whilst Google CEO, Sundar Pichai, warns that society will have to brace itself.
If you are in the market for hyperbole however, this isn’t the place for you. Hymans is running a series of pilots to learn how AI tools can be used safely, ethically, and effectively. To learn more about this, talk to professionals and discover innovative technology, a couple of our Technical Architects recently headed to Microsoft’s AI Build Day at the ExCel in London.
The day was nicely broken up into a keynote session from Scott Hanselman, a series of sessions of several topics such as Using AI in the Cloud, Responsible AI, and using tools such as Copilot.
The afternoon was given over to hands-on labs, which were a great opportunity to try out some of the things we had learned, with experts in the room to ask follow on questions. I found these sessions particularly helpful.
For me some of the key take homes were around responsible usage of AI, and how to build safety in a layered approach from the ground up. This uses both what Microsoft have provided in the model and our own defences higher up the stack such as meta-prompting, grounding, and defending against AI jailbreaks. We also learned about the filtering service in Azure Open AI service and how it can successfully allow a question such as “What is a good axe for chopping firewood?” and block a question such as “What is a good axe for chopping a body?” (A somewhat memorable example).
I was also particularly interested in prompt flow. Which allows both the chaining together of prompt data and models, and crucially allows the tweaking of models iteratively with the ability to test and evaluate as you go.
We also learned about the filtering service in Azure Open AI service and how it can successfully allow a question such as “What is a good axe for chopping firewood?” and block a question such as “What is a good axe for chopping a body?
This was a thoroughly worthwhile day, the opportunity to talk to experts in the products and get hands on experience. We have now brought that information back and working hard to incorporate it into our pilot projects. (And I picked up a pair of free socks!). Next up we have a 3-day workshop with Microsoft and will hopefully have a blog post on what we have been working on soon.
We pride ourselves on being thought leaders and are constantly discussing the many issues facing and shaping our industry. Sign up to find our current thinking on topical issues.
Opens in new window Subscribe
