pip install discus

for the most recent version please do pip install discus@git+https://github.com/discus-labs/discus

https://discus.ai/docs/index.html

Access to high-quality and large datasets is critical when it comes to ML testing/evaluation. Discus is a Python library that leverages LLM's to generate user guided data to solve this critical problem.

Keep up with updates on our twitter or our discord.

Here are a few quick steps to get Discus working.

After installing Discus, make sure to integrate in your LLM provider. For example,

export OPENAI_API_KEY=your-api-key-here

We can now get started. First, create your json following these guidelines:

• task_name: what you want to call your task
• task_type: the type of data you want to generate. Currently either LLM-Instances or LLM-Instructions
• task_explained: the specific guidelines of your task.
• generated_dataset_name: what you want the returned csv to be called.
• model_provider: the LLM you want to use. Currently only OpenAI.
• model_name: the exact model from your provider.
• number_of_rows: the number of data points you want to generate/enrich

config = {
    "task_name": "English2Spanish",
    "task_type": "LLM-Instances",
    "task_explained": "generate english to spanish translation.", # fill in the blank. "you are trying to _____"
    "generated_dataset_name": "eng2spanish.csv",
    "model_provider": "openai",
    "model_name": "gpt-3.5-turbo",
    "number_of_rows": "1500"
}

To run, import Discus. Then, create a Generator object.

from discus import Generator

discus = Generator(config = "config_file_path")
generated_data = discus.run()

Achieve better results by providing your model with a seed dataset.

discus = Generator(config = "config_file_path", seed_dataset = "csv_file_path")
generated_data = discus.run()

Discus is a rapidly developing project. We welcome contributions in all forms - bug reports, pull requests and ideas for improving the library.

Open an issue on Github for bugs and request features. Grab an open issue, and submit a pull request! Discus is a rapidly developing project. We welcome contributions in all forms - bug reports, pull requests and ideas for improving the library.

1. Open an issue on Github for bugs and request features.
2. Grab an open issue, and submit a pull request!