Skip to content
Naibo Wang edited this page May 26, 2023 · 47 revisions

教程导航

EasySpider介绍:中国地震台网采集案例

https://www.bilibili.com/video/BV1Fk4y1L7xX/

如何爬取需要登录才能爬的网站

https://www.bilibili.com/video/BV1HV4y1r7v8

【重要】自定义条件判断之使用循环项内的JS命令返回值

https://www.bilibili.com/video/BV1mu411x7Nn/

如何执行自己写的JS代码和系统代码 (自定义操作)

https://www.bilibili.com/video/BV1qs4y1z7Hc/

如何自定义循环和判断条件

https://www.bilibili.com/video/BV1Ys4y1z777/

如何对元素和网页截图及命令行执行指南

https://www.bilibili.com/video/BV1dV4y1z764/

OCR识别元素内容功能

https://www.bilibili.com/video/BV1xz4y1b72D/

如何爬需要输入验证码的网站

https://www.bilibili.com/video/BV18c411K7FH

如何切换IP池和使用隧道IP - 打开详情页采集案

https://www.bilibili.com/video/BV1KT411t79n

流程图执行逻辑解析 - 58同城房源描述采集案例

https://www.bilibili.com/video/BV1YL411z7uW

MacOS系统设计和执行eBay网站爬虫任务教程

https://www.bilibili.com/video/BV1WL411h71r

如何定时执行任务

https://github.com/NaiboWang/EasySpider/issues/22

如何通过API调用来获得任务执行ID

https://github.com/NaiboWang/EasySpider/wiki/API-Invoke-Example

如何使用命令行执行任务

https://github.com/NaiboWang/EasySpider/wiki/Argument-Instruction https://github.com/NaiboWang/EasySpider/issues/28

任务流程有多个提取数据操作时,软件的执行和输出逻辑

https://github.com/NaiboWang/EasySpider/issues/35

What is EasySpider

EasySpider is a no-code visual web crawler for no-coders and also experts to crawl data from the World Wide Web. It can design and execute web crawling tasks without coding via GUI. The workflow of a new web crawling task can be visually programmed by following EasySpider's visual wizard on the target webpages using an intuitive point-and-click interface. The generated crawler task can then be easily invoked locally or as a web service. Our EasySpider is cross-platform and flexible to adapt to different web-resources. It also supports advanced configuration for complicated tasks and extension. The whole system is open-sourced and transparent for free-access, which avoids possible privacy leakage.

Features of EasySpider

  • Interactive and user-friendly: it provides a user-friendly point-to-click GUI for quick and easy task design for non- programmers. Only a little basic knowledge, such as XPath, is needed to modify the task flow.

  • Flexible: it is able to adapt to various web resources and platforms, dynamic content support, such as collect web content generated by JavaScript (AJAX).

  • Configurable: it supports easy design of complicated crawling tasks with unlimited loops, if-conditions, and fields.

  • Cross-platform: supports on Windows, Linux, and MacOS.

  • Open-Source & Trustworthy: the source code is publicly available, making it a transparent and white-box software, with no privacy leakage risk.

  • Free: all features listed in this documentation are free of charge.

UI of EasySpider

  • UI of Crawler Task design

image

  • UI of Task Information

service_information

  • UI of Task Invocation

service_invoke

  • Example Collected Results

results

Clone this wiki locally