GitLab expands its AI lineup with Duo Chat

Key Takeaways:

– GitLab introduced Duo, a set of AI features aimed at improving developer productivity.
– Duo Chat, a ChatGPT-like experience, has been added to the lineup as a more interactive way to access Duo features.
– GitLab moved its chat backend to Anthropic’s Claude for better information retrieval and context.
– GitLab is partnering with Oracle for cloud-based GPUs and maintains a cloud-agnostic approach.
– Currently, Duo Chat offers code-related chat capabilities, code explanation, and code refactoring, with more features to come.
– Context is crucial for optimal results in the chat experience, and GitLab’s access to all code, even if not open in the IDE, provides an advantage.
– Experienced developers prefer accessing AI tools through Duo Chat rather than code suggestions due to noise.
– Senior developers gravitate towards code generation in chat for guidance and refactoring assistance.

TechCrunch:

Earlier this year, GitLab unveiled Duo, a set of AI features that aim to help developers be more productive by summarizing issues and generating descriptions of epics and issues, as well as through code suggestions and vulnerability explanations, among other features. Today, the company added Duo Chat to this lineup, a ChatGPT-like experience that allows developers to interact with the bot to access the existing Duo features, but in a more interactive experience. Duo Chat is now in beta.

During an interview at KubeCon earlier this week, David deSanto, GitLab’s Chief Product Officer, told me that the idea here is to move many of the existing Duo capabilities into chat between this first beta and the GA launch.

Image Credits: GitLab

DeSanto, who is increasingly becoming the public face of the company, also noted that GitLab moved its chat backend to Anthropic’s Claude. That may come as a bit of a surprise, given that GitLab partnered with Google for other AI features, including its code completion service. “We had not chosen [a model] for chat,” deSanto told me. “We were using our own model — an open source model — and we determined that based on the way chat works within GitLab and the large context that’s needed, a 100k context window makes it a lot easier to get better information in and back.”

He also noted that GitLab is partnering with Oracle for cloud-based GPUs. “We’re cloud-agnostic. We’re going to find the best and all three of them [Google, Oracle and Anthropic] actually worth with each other through us, so it’s been a good relationship.

Right now, in addition to more general code-related chat capabilities, features like ‘explain this code’ and code refactoring are available in Duo Chat. Test case generation, vulnerability explanation and other features will follow soon.

DeSanto noted that over the course of testing these features, it became increasingly clear how important context is for getting the best results in this chat experience. One advantage GitLab has over some other players in this field is that it can access all of your code, even if it’s not currently open in the IDE. In addition, these larger context windows make it easier to keep track of previous conversations.

One interesting observation the team had while watching developers use the tool during the closed preview period was that experienced developers don’t always love code suggestions because they can become noisy. Instead, they prefer to access these AI tools through Duo Chat.

“I thought that chat would be a lot more for associated developers but it seems like they want the inline code completion — and then senior developers gravitate more to code generation in chat,” deSanto said. “The reason was noise. They said: I know what I’m typing. I don’t need you to tell me. But they do maybe want some guidance or some refactoring, for example.”

Source link

AI Eclipse TLDR:

GitLab has introduced Duo Chat, a ChatGPT-like experience that allows developers to interact with a bot to access the existing AI features of Duo. Duo is a set of AI capabilities aimed at helping developers be more productive by summarizing issues, generating descriptions of epics and issues, providing code suggestions, and explaining vulnerabilities, among other features. The addition of Duo Chat aims to provide a more interactive experience for developers. During an interview, David deSanto, GitLab’s Chief Product Officer, mentioned that the company plans to move many of the existing Duo capabilities into chat between the beta and the general availability launch. GitLab has partnered with Anthropic’s Claude for its chat backend, which offers a 100k context window to improve information exchange. Additionally, GitLab is partnering with Oracle for cloud-based GPUs, highlighting its cloud-agnostic approach. Currently, Duo Chat offers code-related capabilities such as code explanation and refactoring, with test case generation and other features to follow soon. GitLab’s access to all code, even if not open in the IDE, and larger context windows provide advantages for better results and tracking previous conversations. Interestingly, experienced developers prefer accessing AI tools through Duo Chat rather than code suggestions, as they find the latter to be noisy.