Sourcegraphlabs
Get Cody

Welcome to the LLM Litmus Test

Compare and find out which LLM works best for your AI coding cases.

Toggle Cody Context to see how Sourcegraph's Cody Context can improve your answers.

This is an LLM comparison between:

GPT-4 Turbo

vs

Claude 3 Sonnet

Using the following repos: PriNova/codypy

GPT-4 Turbo
What does this repo do?

Cody Context Enabled!

Read 84 lines in 4 files

The github.com/PriNova/codypy repository contains a Python project that integrates with the Cody Agent, a tool designed to enhance coding assistance within development environments. This project likely includes functionalities to interact with Cody Agent's features through command-line interfaces or other integration points, facilitating tasks such as code analysis, fetching remote repository data, and handling messages within a webview setup. The repository also includes setup instructions and dependencies required to get the project running, specifically targeting users with a Python environment.

Claude 3 Sonnet
What does this repo do?

Cody Context Enabled!

Read 84 lines in 4 files

The github.com/PriNova/codypy repository contains a Python implementation of the Cody AI coding assistant. Cody is an AI-powered coding assistant created by Sourcegraph that can answer programming questions, explain code, and generate code based on descriptions.

The key features and functionality of this repository include:

  1. Command-line interface (CLI): It provides a CLI tool that allows you to interact with Cody using text input/output in your terminal.

  2. Async communication: It uses Python's asyncio library to enable asynchronous communication with the Cody agent binary.

  3. Remote repository integration: It can fetch information about remote repositories configured in your workspace, enabling Cody to provide enhanced context-aware assistance when working within a Git repository.

  4. Automatic binary download: The Cody agent binary is automatically downloaded based on your operating system and architecture from the official Sourcegraph releases.

  5. Configuration options: It allows you to configure various aspects of Cody's behavior, such as whether to use enhanced context from remote repositories or not.

In summary, this repository aims to provide a Python-based interface for interacting with the Cody AI coding assistant, leveraging its capabilities for code understanding, explanation, and generation while integrating with your local development environment and remote repositories.