How long does a custom dataset take to deliver?

Most custom datasets are collected, enriched, and delivered within 1–3 business days. You will receive an email notification when your dataset is ready.

How are platforms selected for my custom dataset?

You describe your topic and requirements — our AI automatically selects the most relevant platforms from 100+ supported sources including Reddit, YouTube, GitHub, Mastodon, Bluesky, Twitter/X, Telegram, Discord, Medium, and more.

What formats are custom datasets delivered in?

Custom datasets are delivered in CSV, JSON, JSONL, and Parquet formats. All formats are included at no extra cost.

How much do custom datasets cost?

Custom datasets are priced by row count: $18 (up to 25K rows), $28 (25K–50K), $48 (50K–75K), $68 (75K–100K). Pro subscribers get custom datasets included at no extra charge.

What enrichment fields are included?

Every row includes 250+ enrichment fields across 20+ categories: sentiment analysis, emotion detection, topic classification, entity extraction, financial signals, engagement metrics, quality scores, and more.

Can I request private or exclusive datasets?

Yes. You can request private datasets that are not shared with other users. Private datasets include a privacy fee of $11.98 on top of the row-based pricing.

Dataset Request

Request a new dataset

Tell us what you need. We'll collect, enrich, and deliver your private dataset — with a 100-row free sample and permanent archive access.

Request for review

We'll collect your dataset and notify you via email. The full download requires an individual purchase (from $18), with permanent access. 100-row free sample always included.

Free

Dataset Identity

Dataset Name *— used to generate slug

Fields to Include

Choose fields *— 15 selected

Methodology Documentation

15 fields selected

idcontenturltitleauthorauthor_idauthor_followersauthor_verifiedcollected_atpublished_atlikescomments+3 more

Row Count

Choose your row tier— determines price

100-row free sample included. Pay once for full download — permanent access.

Privacy

Keep this dataset private

Adds $11.98 privacy fee. Dataset stays private — only you can access it.

By submitting you agree to our Terms and Privacy Policy

Submitted requests appear in your Dashboard under Custom Datasets

Pricing

Selected tier: $18 + $11.98 privacy fee — pay once, permanent access. Pro plan includes free custom datasets.

Enrichment Pipeline

Every custom dataset goes through our deterministic enrichment pipeline with 250+ computed fields per record.

1. Auto-Select Platforms

AI analyzes your description, category, and fields to select 50–75 relevant platforms automatically.

2. Generate Dataset Description

AI writes a concise 1-2 sentence description of the dataset based on your input, category, and selected fields. Used for catalog display and metadata.

3. Expand Search Queries

AI generates 50–300 optimized search queries covering multiple angles: tutorials, comparisons, opinions, news, how-tos, best-of lists, and trends. Query count scales with selected row tier. For large counts, queries are generated in parallel batches to guarantee full coverage without truncation.

4. Optimize Field Selection

15 CORE fields (id, content, url, author, engagement metrics, etc.) are always included for data quality and consistency. Additional field groups auto-suggest based on description keywords — sentiment, financial, technical, health, gaming, and more.

Enrichment Pipeline

Smart Scheduling: Collection tasks are prioritised and queued. Each platform is scraped using custom-built adapters.

Post-Level Enrichment: Each collected post is analysed for sentiment, emotion, topics, financial signals, and domain-specific features (crypto tickers, game titles, health conditions, etc.).

Deduplication: Content is deduplicated by hash across platforms to ensure clean, unique data.

Multi-Format Export: Delivered as CSV, JSON, JSONL, and Parquet with schema documentation.

Deterministic enrichment — every field reproducible from source code.

SocialINTEL

Fetching datasets…

Enrichment Pipeline

Smart Scheduling: Collection tasks are prioritised and queued. Each platform is scraped using custom-built adapters.

Post-Level Enrichment: Each collected post is analysed for sentiment, emotion, topics, financial signals, and domain-specific features (crypto tickers, game titles, health conditions, etc.).

Deduplication: Content is deduplicated by hash across platforms to ensure clean, unique data.

Multi-Format Export: Delivered as CSV, JSON, JSONL, and Parquet with schema documentation.