BettaFish has no data: how do I feed it public Xiaohongshu and Douyin data? (2026)
About $0.92 a topic with DataXAPI, using no account of yours: BettaFish's Insight Agent reads its own database, which its MindSpider crawler is meant to fill, with a scan to log in on each platform the first time. If you would rather not keep accounts for it, write public notes, videos and comments from a data API into the same tables. DataXAPI reads Xiaohongshu (RedNote) with 21 endpoints, from $0.0200 a call; a failed call is not charged.
Updated 2026-11-04
What it needs
Its README says data crawling is run separately: python main.py --deep-sentiment --platforms xhs dy wb in MindSpider. The content goes to tables such as xhs_note, xhs_note_comment, douyin_aweme and douyin_aweme_comment, in PostgreSQL by default or MySQL. You still need the model keys it asks for: data does not replace them. MindSpider's README also says it is for study and reference, with no commercial use.
Which field goes where
We wrote this from its table definitions and have not run the whole system on it, so try a few rows first. xhs_note.time and douyin_aweme.create_time are compared as millisecond timestamps in its search code. topic_id and crawling_task_id can be left empty. Xiaohongshu search gives an excerpt: xiaohongshu.notes.get has the whole text, at $0.0200 a note.
| From DataXAPI | xhs_note | douyin_aweme |
|---|---|---|
id | note_id | aweme_id |
title, text | title, desc | title, desc |
published_at | time | create_time |
author.id, author.name | user_id, nickname | user_id, nickname |
metrics.likes, .favorites | liked_count, collected_count | liked_count, collected_count |
metrics.comments, .shares | comment_count, share_count | comment_count, share_count |
url | note_url | aweme_url |
| The search word | source_keyword | source_keyword |
Comments, and what a topic comes to
A comment's id, post_id, text, published_at, metrics.likes, metrics.comments and parent_id go to comment_id, note_id or aweme_id, content, create_time, like_count, sub_comment_count and parent_comment_id.
One topic. Xiaohongshu: one search at $0.0200, then 2 pages of comments under 20 notes at $0.0200: $0.82. Douyin: one search at $0.0200, then 5 pages of comments under 8 videos at $0.0020: $0.10. So $0.92 for about 1,200 comments.
Endpoints
Each with its price; every page has the parameters, the fields and a recorded response.
Sources
What this page says of other services is from their own pages and documents, read on 2026-11-04. Prices and features change: check the source before you decide.