LogoLogo
  • Developers
    • Macrocosmos SDK
      • Get Started
      • API Keys
      • Subnet 1 Apex API
      • Subnet 13 Gravity API
    • Tools
      • Macrocosmos MCP
  • SUBNETS
    • Subnet 1 Apex
      • Subnet 1 Getting Started
      • Subnet 1 Mining Setup Guide
      • Subnet 1 Incentive Mechanism
    • Subnet 9 IOTA
      • Subnet 9 Incentive Mechanism
      • Subnet 9 Mining Setup Guide
      • Subnet 9 Validating
    • Subnet 13 Data Universe
      • Subnet 13 Getting Started
      • Subnet 13 Data Universe API
      • Subnet 13 Incentive Mechanism
    • Subnet 25 Mainframe
      • Subnet 25 Getting Started
      • Subnet 25 Mainframe API
        • API Keys
        • Folding API
          • Running Folding API Server
          • Endpoints
        • Organic API
          • Endpoints
      • Subnet 25 Incentive Mechanism
  • Subnet 37 Finetuning
    • Subnet 37 Getting Started
    • Subnet 37 Mining Setup Guide
    • Subnet 37 Validating Setup Guide
    • Subnet 37 Incentive Mechanism
    • Subnet 37 Competitions
  • CONSTELLATION - USER GUIDES
    • Apex User Guide
      • Navigating Apex
      • FAQs
    • Gravity User Guide
      • Scraping data
      • Managing and Collecting your data
      • FAQs
    • Nebula User Guide
      • Explore Nebula
      • Analyzing data
  • About us
    • Bittensor
      • DTAO
    • News and updates
    • Macromedia
    • Subnet Status Update
Powered by GitBook
On this page
  • Track and Manage Your Tasks in Gravity
  • Build Your Dataset
  1. CONSTELLATION - USER GUIDES
  2. Gravity User Guide

Managing and Collecting your data

PreviousScraping dataNextFAQs

Last updated 2 months ago

Track and Manage Your Tasks in Gravity

To monitor your scraping progress and access results, go to your Task Library. This is where you’ll see the current status of each task you’ve submitted.

Pending: Your task is waiting in the queue.

Running: Miners are actively working on your request.

Build Your Dataset

To build a dataset for a single topic, click “Build Dataset” next to it.

To fulfill your entire task, click “Build All.”

After clicking "Build All" Gravity begins collecting and preparing data across for the selected labels across X and reddit. The task moves through a few key processing stages: Validating Data Sources, Collecting Available Data Sources and Collecting Crawler Information

Validating Data Sources Gravity is checking each selected topic (like r/tech or r/googlepixel) to ensure the source is reachable, active, and properly formatted for extraction.

Collecting Available Data Sources This stage begins retrieving all accessible data from the validated sources.

Collecting Crawler Information Gravity’s crawlers structure the data further.

It takes several minutes for dataset to be built, once your dataset is ready, you’ll get an email notification. Return back to your task library and you’ll also see a “View Dataset” button in your task row. Click it to preview the data.

Download your data

To download, hit “Download” — files are exported in CSV and Parquet format.

Cancel a Task

Tasks run for 7 days by default. To stop a task early, click “Cancel.”

If you cancel:

You can still preview or download any completed datasets.

You won’t be able to build new ones from topics till in pending status