Oscar Triscon - Applied Language Understanding

Applied Language Understanding

Oscar Triscon

Evaluating GPT-4-Turbo

Evaluating GPT-4-Turbo

Last Monday (November 6, 2023) OpenAI held their first developer day conference and unveiled several new features. To us, one of the most interesting announcements was the launch of the new GPT-4-Turbo LLM. If you've used GPT-4 for any length of time you know that, at least through

Participating in Atlassian's codegeist unleashed

Participating in Atlassian's codegeist unleashed

Every year, Atlassian organizes a hackathon called codegeist unleashed. This year it's fully devoted to applications of AI on Atlassian's products, another demonstration of Atlassian's vision and commitment to AI. For the hackathon, we set out to implement the ability to operate on structured

Evaluating Atlassian Intelligence

Evaluating Atlassian Intelligence

Back in April at their annual TEAM conference, Atlassian announced Atlassian Intelligence, a suite of AI-enabled features across the entire product line. This vision and level of commitment to AI's role in the future of every Atlassian product is very exciting. After a few months of eager anticipation,

Streaming OpenAI function calls

Streaming OpenAI function calls

Given the long latency that LLMs currently introduce doing inference, streaming the responses to the user as they are generated is almost a requirement in AI applications. Streaming decreases the perceived and actual wait for results – the user can start reading and reflecting on the results as soon as output

Signing API requests with the AWS SDK for JavaScript v3

Signing API requests with the AWS SDK for JavaScript v3

If you use the AWS SDK for JavaScript in e.g. a node.js application, invoking a command on an AWS service generally involves instantiating a client for the service (e.g. DynamoDBClient or S3Client) and invoking a method on that client. The client will do all the work to

Gaucho: our evaluation tool

Gaucho: our evaluation tool

We talked recently about the importance of evaluation in continously improving and keeping Connie AI honest. At the beginning, we were running our evaluations through command-line scripts. We would check the output files into git, and as part of the commit we would diff the results and visually check that

Zen and the art of Q.A.

Zen and the art of Q.A.

Our initial RAG-based question answering system worked surprisingly well out of the box, a testament to how good foundation models are. They are also relatively flimsy: a change in a prompt may cause a whole category of questions to suddenly not be answered correctly. In order to make sure we

Starting with a RAG

Starting with a RAG

Thousands of teams around the world use Confluence to collaborate and share information. Just like in any other system of record for knowledge, a lot of effort goes into writing documents, and it also takes effort to keep those documents updated. And, as time passes and organizations and their content

Welcome

It's not a secret that AI has unleashed a new wave of startups. The advances in foundation models have not only opened our collective imaginations, but also provided fertile grounds to build new tools that we didn't think feasible only a few years ago. We – Matt