Repository navigation
Release BEAT training dataset on Hugging Face #1
Description
Hi @ZQS1943 🤗
I'm Niels and work as part of the open-source team at Hugging Face. I discovered your work through Hugging Face's daily papers as yours got featured: https://huggingface.co/papers/2510.27623.
The paper page lets people discuss about your paper and lets them find artifacts about it (your dataset for instance),
you can also claim the paper as yours which will show up on your public profile at HF, add Github and project page URLs.
I noticed in your GitHub README that the "full training set" for SFT and CTL is available upon request due to ethical considerations. Would you be interested in hosting this dataset on https://huggingface.co/datasets?
We understand the ethical considerations around the data, and we can support controlled access or provide guidance on how to share sensitive data responsibly, if that's a concern. Hosting on Hugging Face will give you more visibility/enable better discoverability, and will also allow people to do:
from datasets import load_dataset
dataset = load_dataset("your-hf-org-or-username/your-dataset")If you're down, leaving a guide here: https://huggingface.co/docs/datasets/loading.
Besides that, there's the dataset viewer which allows people to quickly explore the first few rows of the data in the browser.
After uploaded, we can also link the datasets to the paper page (read here) so people can discover your work.
Let me know if you're interested/need any guidance regarding controlled access or uploading!
Kind regards,
Niels
Activity
ZQS1943 commentedon Nov 4, 2025
Hi Niels,
Thanks for reaching out! We’re glad to see our work featured on Hugging Face’s Daily Papers 🤗
We’re happy to release and host our dataset on Hugging Face with gated access. One question: our dataset is quite large (tens of gigabytes) since it includes a substantial number of images — would that size be manageable for hosting on Hugging Face?
Best,
Qiusi
NielsRogge commentedon Nov 4, 2025
Yes we support up to 300 GB! If you need more feel free to request a storage grant https://huggingface.co/docs/hub/en/storage-limits.
Regarding gated datasets, here's a guide: https://huggingface.co/docs/hub/en/datasets-gated
ZQS1943 commentedon Nov 5, 2025
Got it! I’ll start working on the upload. Really appreciate the information and guidance.