cms base

CMS 采集系统是一种可以有效提高站点流量和内容质量的工具。在选择采集系统时,需要根据自己的实际需求和预算进行选择。同时,在使用过程中需要遵守法律法规和伦理道德,保证内容质量和原创性

# category

# RSS 源采集

RSS 的全称为 Really Simple Syndication(简易信息聚合)源是一种用于发布经常更新数据的 XML 格式文件。基于 RSS 源的采集系统可以通过订阅 RSS 源,获取其中的文章信息。这种采集方式具有速度快、易操作等优点。 rss 相关内容 jump

# API 接口采集

# 爬虫技术采集

# CMS 采集系统推荐

采芝壹号
爬虫神器
RSSHub

# CMS 采集系统注意事项

# 资源

# 视频采集网址

# 海外看采集

# api

param
- ac
  - list
  - detail
- ids: 使用,分开
- h: 小时
https://api.haiwaikan.com/v1/vod?ac=list&pg=5 (opens new window): 采集视频列表部分,参数表示第五页
https://api.haiwaikan.com/v1/vod?ac=detail&ids=123,124 (opens new window): 视频详情,支持传入多个 id。参数表示 vod_id 为 123,124.
https://dp.haiwaikan.com/index.html?url= (opens new window): M3U8 专用解析接口

# curl 模拟采集

1.获取接口内容

curl -X GET 'https://api.haiwaikan.com/v1/vod?ac=list' \
     -H 'Accept: text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.7' \
     -H 'Accept-Encoding: gzip, deflate, br, zstd' \
     -H 'Accept-Language: zh-CN,zh;q=0.9,en-US;q=0.8,en;q=0.7' \
     -H 'Cache-Control: no-cache' \
     -H 'Cookie: _ga=GA1.1.1460337515.1715012009; _ga_21FB2D86ZH=GS1.1.1715946675.10.0.1715946675.0.0.0; _ga_LS9K5BZN52=GS1.1.1715946676.7.0.1715946676.0.0.0' \
     -H 'Pragma: no-cache' \
     -H 'Priority: u=0, i' \
     -H 'Sec-Ch-Ua: "Chromium";v="124", "Google Chrome";v="124", "Not-A.Brand";v="99"' \
     -H 'Sec-Ch-Ua-Mobile: ?0' \
     -H 'Sec-Ch-Ua-Platform: "macOS"' \
     -H 'Sec-Fetch-Dest: document' \
     -H 'Sec-Fetch-Mode: navigate' \
     -H 'Sec-Fetch-Site: none' \
     -H 'Sec-Fetch-User: ?1' \
     -H 'Upgrade-Insecure-Requests: 1' \
     -H 'User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/124.0.0.0 Safari/537.36' \
     --output response.bin

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18

2.通过分析文件二进制特征,response.bin为 gz 压缩文件.解压它

# 将 response.bin 解压为 response 解压后的文件
mv response.bin response.gz
gunzip response.gz
# 参看
cat response

1
2
3
4
5

--compressed自动处理压缩的响应数据

curl -X GET 'https://api.haiwaikan.com/v1/vod?ac=list' \
     -H 'Accept: text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.7' \
     -H 'Accept-Encoding: gzip, deflate, br, zstd' \
     -H 'Accept-Language: zh-CN,zh;q=0.9,en-US;q=0.8,en;q=0.7' \
     -H 'Cache-Control: no-cache' \
     -H 'Cookie: _ga=GA1.1.1460337515.1715012009; _ga_21FB2D86ZH=GS1.1.1715946675.10.0.1715946675.0.0.0; _ga_LS9K5BZN52=GS1.1.1715946676.7.0.1715946676.0.0.0' \
     -H 'Pragma: no-cache' \
     -H 'Priority: u=0, i' \
     -H 'Sec-Ch-Ua: "Chromium";v="124", "Google Chrome";v="124", "Not-A.Brand";v="99"' \
     -H 'Sec-Ch-Ua-Mobile: ?0' \
     -H 'Sec-Ch-Ua-Platform: "macOS"' \
     -H 'Sec-Fetch-Dest: document' \
     -H 'Sec-Fetch-Mode: navigate' \
     -H 'Sec-Fetch-Site: none' \
     -H 'Sec-Fetch-User: ?1' \
     -H 'Upgrade-Insecure-Requests: 1' \
     -H 'User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/124.0.0.0 Safari/537.36' \
     --compressed

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18

# link

建站项目
- IceCMS (opens new window)
- pages-cms (opens new window), A user-friendly CMS for static site generators.
- outstatic (opens new window), Outstatic - A static CMS for Next.js
- maccms10 (opens new window), 苹果 cms 官网. 使用
资讯
资源采集站
- 资源采集站大合集 (opens new window)
- 2024 年最新可采集 CMS 视频资源站网址合集 (opens new window)

#cms

上次更新: 2025/10/09, 23:53:03

← smali调试抖音app maccms→