Scraping Data

Use the Macrocosmos icon to navigate the menu

Create a New Task to collect data

You might be interested in building an app that tracks public reactions to new tech launches. You want live posts from Reddit, X and Youtube.

Step 1: Name your task. For Example: TechNews Tracker

Step 2: Specify your data source, or scrape from any!

Step 3: Define your keywords. Tell Gravity what to find.

Mission Commander

Mission Commander (MC), our specialized AI assistant can also help provide the relevant keywords for you task, all you have to do is ask! Mission commander is powered by Subnet 1 Apex

Step 1: Write a request

Start by telling MC what type of data you'd like to collect.

Step 2. Correct the labels and keywords, if needed

If the labels aren't quite right, you can edit manually or ask mission commander to fix it.

Step 3: Pick a date range

Pick the dates if you would like to define period when the data was published.

Step 4: Launch the Task

Once you’re happy with the request and the label setup, hit Launch data collection. You will be automatically redirected to your task library. Your task will be deployed and the data will satrt to be collected in real time.

You can also interact with Gravity using our APIs . Click here to access Subnet 13 Gravity API.

Last updated