Bigset：开源工具，一句话生成结构化数据集

精选理由

Bigset 解决了手动收集和整理网络数据的高成本问题，适合需要快速获取结构化数据集的开发者、数据科学家或研究者，直接输入自然语言就能拿到结果，值得一试。

AI 摘要

Bigset 是一个开源工具，用户只需描述所需数据，即可自动生成结构化数据集。它通过编排智能体搜索网络，并派发子智能体并行抓取数据，最终输出可下载的 CSV/JSON 文件。例如，输入“亚马逊上所有徕卡镜头”或“京都徕卡门店及评分”，即可获得整理好的数据。该工具底层调用 TinyFish 的免费搜索与抓取 API，支持定时刷新和自托管。对于需要快速收集结构化信息的开发者、数据科学家或研究者，Bigset 提供了一条低代码、高效率的路径。

原文 · Ate-a-Pi

Here is an open-source tool to generate a complete…

Here is an open-source tool to generate a complete dataset.

1. Describe the data you want 2. An orchestrator agent searches the web 3. Sub-agents run in parallel to fetch the data 4. You get a structured dataset you can download

For example, you can run Bigset with the query "all leica lenses being sold on amazon", or "leica stores in kyoto with their opening hours and ratings".

Bigset uses @Tiny_Fish's free Search and Fetch APIs in the background. You can configure it to refresh the data on a schedule.

You can self-host it with your own keys.

Here is the GitHub repository: https://t.co/2wqDTJRgbP. You can get free TinyFish API keys here: https://t.co/3z0yhheLiO

Thanks to the TinyFish team for partnering with me on this post.

查看原推