We use essential cookies to keep you signed in and improve your experience. Cookie Policy
Product Updates
Changelog
Track every update, improvement, and fix shipped to Social Intel.
v2.7.0 July 14, 2026
Header Resources Menu, Site-Wide Design Refresh & Data Collection Reliability
A new Resources menu in the header, a refreshed look across key pages, a new dataset license page, more reliable data collection, and cleaner datasets.
New "Resources" dropdown in the header — quick access to Docs, Methodology, Data Quality, API Docs, Changelog, Blog, and FAQ with short descriptions
New Dataset License legal page detailing how purchased datasets may be used
Site-wide design refresh — new page hero and section layouts across the landing, pricing, about, features, and legal pages
More reliable data collection — long-running jobs are no longer interrupted, with worker reliability fixes
Cleaner datasets — improved scoring to filter spam, noise, and explicit content more accurately
Dataset preview reliability — sample buttons and full-download fallback so previews always load
Various platform scraper fixes for more stable data collection
New referral program, guided onboarding flow, expanded dashboard with usage stats and notifications, faster data collection, and a new product-led growth engine for automated engagement campaigns.
New referral program — invite others and track rewards from your dashboard
Guided onboarding flow for new users to get started faster
New dashboard widgets: usage stats, notification bell, usage meter, and testimonial carousel
Automated engagement campaigns — personalized check-ins, tips, and re-engagement emails
Data collection up to 35% faster per batch with increased query concurrency
Reduced memory usage across scraping infrastructure for better stability
Adaptive timeout handling — platforms that time out get shorter wait times on retry
Pro plan dataset row limits — catalog now shows per-dataset limits and upgrade prompts when exceeded
Dataset cards redesigned — unified "View Details" button with cleaner price badges under platform icons
Dashboard streamlined with re-engagement banner, onboarding checklist, and referral link
Export field flattening improved for nested data with better collision handling
Financial signal detection narrowed — removed overly broad keywords that caused false positives
Health condition detection now excludes economic/weather/demographic uses of "depression"
Copyright detection now requires fingerprint to be substantial portion of content — reduces false flags on citations
High hashtag density quality flag added — flags posts with excessive tag-to-content ratio
Inflated engagement metrics capped for platforms known to fabricate engagement data
Placeholder content detection expanded — music metadata, photo captions, Docker packages, and Unsplash now filtered
VADER sentiment now correctly zeroes confidence for unclassified language content
Suppressed misleading database error logs during rate-limited requests
Various scraper reliability fixes across 30+ platforms
v2.5.0 July 6, 2026
Detection Quality, Language & Topic Improvements
Major enrichment pipeline upgrades with expanded topic coverage, improved language detection, streamlined batch processing, and guaranteed field defaults for all records.
Expanded topic keyword coverage across politics, sports, business, health, gaming, and media for better content categorization
Topic detection now considers hashtags alongside content to avoid missing relevant classifications
Improved German, Spanish, and French language detection with function-word pre-checks
Non-English content filtered at collection time for English-focused datasets
Enrichment pipeline streamlined with larger batch sizes and graceful error handling
Every enrichment record now includes typed defaults for all fields — prevents missing data in exports
Reduced false positives in hate, crisis, mental health, and echo chamber signal detection
Private dataset support extended across export and storage systems
Temporal features now skip scrape-time-only dates to prevent incorrect hour/day classifications
Content older than 3 years flagged as very stale for improved data freshness awareness
Platforms without engagement data (GitHub, GitLab, SourceForge, etc.) now handled correctly instead of showing zero engagement
Trusted domain list expanded for phishing detection — fewer false positives on legitimate content platforms
Sentiment-emotion contradiction detection improved — now corrects sentiment label instead of overriding emotion
Reduced false language gate triggers on content with emoji and accented characters
v2.4.2 July 3, 2026
Bug Fix Release
Data quality improvements, SEO upgrades, custom dataset enhancements, and various reliability fixes.
Reduced false positives in enrichment signals — improved satire, FUD, echo chamber, and recruitment detection accuracy
Fixed sentiment-emotion contradiction checks to respect polarity alignment
Added sentiment score consistency validation
Fixed task scheduling conflicts between custom and catalog datasets
Fixed dataset row range display for custom datasets
Fixed export file timestamp accuracy
Increased custom dataset recommended platform range from 50-75 to 75-100 for better coverage
Open Graph images, Twitter cards, and canonical URLs added across catalog, changelog, contact, data quality, custom datasets, and more pages
JSON-LD article schema added to changelog and data quality pages for richer search results
Improved catalog metadata reliability with additional fallback sources
Applied defense-in-depth hardening across the API layer, sanitized error responses to prevent information leakage, improved authentication paths, and fixed several platform scrapers.
Server error responses sanitized — internal details no longer exposed to clients
Additional server-side request validation added for enhanced security
Extended authentication methods with additional header-based auth support
Sensitive credential logging improved to prevent exposure in log files
Authentication failure logging enhanced for better monitoring
Default admin role configuration updated for newly registered keys
LLM dependency removed from enrichment — replaced with deterministic rule-based engine. PayPal subscription flow overhauled for reliability. Major improvements to language detection, content classification, and content signal accuracy.
LLM/GROQ enrichment replaced with heuristic rule engine — same 80+ fields, zero API costs, fully deterministic, <1ms per post
NSFW detection now scans hashtags and tags (AO3, fanfiction, etc.)
New topic categories: "fandom" (fanfic, anime, kpop, AO3) and "entertainment" (music, broadway, theater)
Improved code detection for technical content in posts
60+ new game titles added to Twitch/gaming content detection
Improved language detection for non-English content with hashtag-aware fallback
Topic detection sensitivity increased for better recall
PayPal subscription flow reliability improvements during plan changes and capture
Server-side price verification added for payment integrity
Payment order state management hardened against edge cases
Webhook processing reliability improvements
Subscription lifecycle webhook coverage expanded
Content security policy updated for asset delivery
Dataset download authorization check hardened
Error logging upgraded — better tracebacks for debugging
v2.3.0 June 25, 2026
Enrichment Expansion, Subscription Overhaul & SEO Upgrade
Major enrichment pipeline refactor with 80+ new fields, unified subscription flow through PayPal orders, expanded entity extraction, bot detection, on-chain crypto signals, streaming platform support, and structured data across the site.
Posting time analysis fields: hour, day, period, weekend, business hours
Module-level reliability flags for all enrichment domains (sarcasm, emotion, LLM, aspect, financial, signals, quality, classification, domain)
Pipeline metadata tracking for improved transparency into enrichment status
Subscription flow unified — plans now use createOrder/captureOrder with auto-created PayPal subscriptions
PayPal subscription auto-activation on capture with activation API endpoint
PayPal card fields UI with dedicated styling and error handling
FAQPage JSON-LD schema for rich search results
Breadcrumb structured data (ScriptBreadcrumb component) on FAQ, Features, Pricing, Legality, and Security pages
New custom dataset field groups: Quality & Safety, Composite Scores, Entity Extraction, Bot Detection, On-Chain Events, Posting Time
DeviantArt scraper reliability improved
Epic Games scraper fixes and Reddit scraper optimizations
Custom dataset query count tiers increased for larger collections
Quality score recalculation with refined weighting for more accurate results
Fixed sentiment and emotion score capping for consistency
Quality Score Recalculation check added to data quality page with transparent formula
v2.2.2 June 20, 2026
Favorites Sync, Purchased Tab, Language Detection & Quality Checks
Server-side favorites with new API endpoints, purchased datasets tab in dashboard, smarter language detection with fewer false positives, and expanded quality checks.
Server-side favorites — favorites now sync across devices
Catalog and dashboard favorites now sync with server, fall back to localStorage offline
New Purchased tab in dashboard showing owned datasets from catalog
User profile now returns owned and favorited dataset info
Catalog record count accuracy improved
Fixed last_updated timestamps in catalog for accuracy
Exports now always include a sample file
Language detection: improved Japanese detection, reduced false positives on technical content
VADER sentiment analysis optimization for faster processing
Data quality page: 2 new enrichment checks (sentiment score-label consistency, improved spam detection)
Major custom dataset upgrade with privacy toggle, purchase flow, email notifications, and record tracking. New translation pipeline for non-English content. Admin TOTP 2FA and cookie-based auth.
Custom dataset privacy toggle — users choose private ($11.98 fee) or public (free, catalog)
Purchase flow for custom datasets via checkout page with price display
Record count display on custom dataset cards and modal
Email notifications when custom dataset collection completes
Non-English content translation pipeline
Domain extraction pipeline improvements
Admin multi-factor authentication support
Cookie-based authentication support
Profile picture upload with image validation
Individual pricing tier up to 100K rows ($68)
Pro users skip payment for custom datasets in dashboard
Increased posts per query limit for data collection
Better rate limit error messages with plan name and upgrade link
Fixed free plan API rate limit to align with published terms
Fixed Pro plan feature discrepancies between monthly and yearly
Improved error logging and cleanup on enrichment failures
v2.2.0 June 14, 2026
Platform Expansion & UX Overhaul
New data sources, simplified pricing, redesigned catalog, and major performance improvements across the platform.
30+ new API-based data source collectors (arXiv, HuggingFace, npm, PyPI, and more)
New pages: Waitlist, Data Quality, Chat, Help Center, and Admin panel
Simplified pricing — removed Max plan, consolidated to Pro monthly/annual
PayPal card fields integration for secure direct card payments
Catalog: sessionStorage caching, framer-motion animations, all datasets accessible to all users
Dashboard: download history synced with server, resend verification via POST
Unified API base URL across all frontend pages for consistent routing
Redesigned features page with new hero components and motion transitions
Billing page updated with invoice request flow
New CookieBanner, Chatbot, and AuthNavButton components
v2.1.0 May 30, 2026
Streamlined Platform — Live Streaming Removed
Removed the live data streaming feature to simplify the platform. WebSocket endpoints, Live Stream tab, and related plan features have been dropped.
Removed Live Stream tab from the dashboard
Removed live data streaming endpoints
Updated features page, pricing, and checkout to remove streaming references
v2.0.0 May 22, 2026
Social Intel 2.0 — Complete Platform Relaunch
Everything you loved about 1.0, reimagined. 100+ platforms, AI enrichment pipeline, redesigned catalog, and new pricing.
100+ platforms — Reddit, YouTube, GitHub, Medium, HackerNews, Mastodon, Bluesky, and more
AI enrichment pipeline: sentiment, emotion, topics, financial signals, jobs data — 150+ fields
New pricing: All datasets free · Custom datasets from $18 · Pro at $78/mo
Redesigned catalog with grid/list view, filters, and search
Interactive dataset preview with schema explorer
PayPal integration for secure payments
Migrated to Next.js 16 App Router for improved performance
v1.9.0 May 10, 2026
Custom Dataset Dashboard
Pro users can now track, manage, and download custom dataset requests directly from the dashboard.
New "Custom Requests" tab in the dashboard
Real-time status updates for in-progress datasets
Inline chat with our data team on each request
Reduced turnaround time to 1-3 days
v1.8.0 Apr 22, 2026
10 New Datasets & Enrichment Expansion
Major catalog expansion with 10 new datasets and 15 new enrichment fields across all platforms.
5 new Reddit datasets: r/CryptoCurrency, r/stocks, r/technology, r/science, r/worldnews
3 new GitHub datasets: security advisories, package ecosystem
2 new YouTube datasets: educational content, product reviews
Added financial signal detection enrichment field
Improved sentiment accuracy across all English-language datasets (+6% F1)
v1.7.1 Apr 12, 2026
Bug Fix Release
Stability fixes for the catalog, export, and API systems.
Fixed catalog search freezing on rapid filter changes
Resolved JSONL export truncation for large datasets
Fixed broken pagination on the dataset detail page
v1.7.0 Apr 5, 2026
Performance & API Improvements
Major backend optimization reducing download times and improving API reliability.
Download speeds significantly improved with transfer optimization
API response times reduced by 35% with query optimization
Added column filtering parameter to dataset download endpoint
Fixed Parquet export for datasets with null enrichment fields
Resolved rate limiting edge case for concurrent requests
v1.6.1 Mar 24, 2026
Platform Expansion — HackerNews & Stack Overflow
Added two new platform collections: HackerNews discussions and Stack Overflow Q&A.
New HackerNews dataset: top stories, comments, and job threads
New Stack Overflow dataset: questions, answers, and voting data
Cross-platform topic clustering for Reddit + HackerNews content
v1.6.0 Mar 15, 2026
Developer Tools & API Improvements
Released improved API docs, Python SDK, and developer experience improvements.
Python SDK package (pip install socialintel)
Interactive API playground in the docs
OpenAPI spec now includes all endpoints with request/response examples
Improved error responses and rate limit headers
v1.5.2 Feb 18, 2026
Platform Expansion — Mastodon & Bluesky
Expanded beyond traditional platforms into federated and decentralized social media.
New Mastodon dataset: public posts, hashtags, and federation activity
New Bluesky dataset: posts, reposts, and engagement metrics
Unified author identity resolution across platforms
v1.5.1 Feb 3, 2026
Catalog Quality & Metadata Upgrade
Enhanced dataset metadata, better search, and improved preview quality.
Added rich dataset descriptions with update frequency and row counts
Improved catalog search with fuzzy matching and typo tolerance
Fixed sample preview not loading for large datasets
v1.5.0 Jan 20, 2026
Security & Infrastructure
Security hardening, infrastructure upgrades, and compliance documentation.
Added security hardening headers
Rate limiting per IP and per API key based on plan tier
GDPR compliance documentation and data processing agreement
Upgraded encryption standards and security protocols
v1.4.2 Jan 14, 2026
Custom Request & Pipeline Fixes
Bug fixes for the custom dataset request flow and collection pipelines.
Fixed email notification not sending on request completion
Resolved pipeline timeout for datasets with 100k+ records
Reduced collection latency for real-time platforms
v1.4.0 Jan 5, 2026
Custom Dataset Requests
Need data we don't have? Request custom collections — we collect, clean, and deliver in days.
Custom dataset request form with platform/keyword/date filters
We collect, clean, and deliver custom datasets in days
Handles Reddit threads, GitHub repos, YouTube videos & Medium articles
v1.3.1 Dec 22, 2025
Dashboard Stability & UI Polish
Bug fixes and interface improvements for the new dashboard.
Fixed download history showing incorrect file sizes
Resolved account tab not saving preference changes
Improved mobile layout for usage statistics cards
v1.3.0 Dec 15, 2025
Dashboard & Analytics
User dashboard with usage analytics, download history, and account management.
Dashboard with Overview, Datasets, History, and Account tabs
Usage statistics with animated counters
Download history with search and filtering
v1.2.1 Dec 11, 2025
Export & API Refinements
Improvements to export reliability and API documentation.
Improved error messages for failed downloads
API docs now include curl examples for every endpoint
Fixed JSON export missing nested fields in some datasets
v1.2.0 Dec 8, 2025
Multi-Format Downloads & API
Expanded export formats and launched the REST API for programmatic access.
Streaming downloads for large datasets
Export formats: CSV, JSON, JSONL, Parquet
REST API — no SDK needed, just your HTTP client
Free samples available without signup
v1.1.0 Dec 1, 2025
100+ Premium Datasets
Expanded catalog to 100+ premium datasets with pre-processed sentiment scores, topic tags, and engagement signals.
100+ premium datasets across Reddit, YouTube, GitHub & Medium
Pre-processed with sentiment scores, topic tags, and engagement signals
Daily automated collection pipelines
Free datasets under 500 records — no account needed
v1.0.0 Dec 2025
Social Intel Launch
Social Intel 1.0 launched — premium social media datasets for AI training, research, and analytics.
100+ premium datasets across Reddit, YouTube, GitHub & Medium
Reddit threads, GitHub repos, YouTube videos & Medium articles — pre-processed with sentiment scores, topic tags, and engagement signals
Daily automated collection pipelines
Streaming downloads in CSV / JSON / JSONL / Parquet
REST API — no SDK required
Free samples (no signup) + free datasets under 500 records
Custom dataset collection — we collect, clean, and deliver in days