What is crawler and Why should I learn crawler

[fzdy1914]

Topic: Web Crawler

Link to slides: File

Intended impact:

Know: What is Web Crawler and Why should learn Web Crawler
Believe: Web Crawler is an strong tool to find information
Do: Start writing Web Crawler now.

WIIFY:

You should learn Web Crawler to find, filter, store the information more easily.

Key points:

• KP1: Web Crawler is an Internet Bot to find relevant information.
• KP2: There are only three parts of knowledge needed to write a Crawler
• KP3: Crawler Frameworks can reduce the code to write.

Call-to-action:

Do not hesitate and write your own Web Crawler today.

Roadmap:

• What is Web Crawler
• Basic knowledge needed:
  • Basic programming knowledge
  • Basic HTTP protocol knowledge
  • Knowledge about Regex and Xpath
• Web Crawler Frameworks

PUNCH:

The example of GEH1004 final paper

[fzdy1914]

https://drive.google.com/open?id=16ZY39Y6tbKTzdvRVGNrSn4ezTIeCWXsI