24 lines
1.3 KiB
Markdown
24 lines
1.3 KiB
Markdown
**English** · [Dansk](Home-da) · [Bahasa Melayu](Home-ms)
|
|
|
|
# scrape-movies wiki
|
|
|
|
Day 45 of Udemy's "100 Days of Code: The Complete Python Pro Bootcamp" is about web scraping with Requests and BeautifulSoup. This repository reproduces every lecture step as tested Python code. This wiki shows each step with a screenshot and explains what we gained from it.
|
|
|
|
## Pages
|
|
|
|
| Page | Lecture | What you get |
|
|
| --- | --- | --- |
|
|
| [Setup](Setup) | - | Create the `.venv`, install, run the tests |
|
|
| [Parsing HTML](Parsing-HTML) | Parsing HTML and making soup; finding and selecting elements | Five steps with screenshots |
|
|
| [Hacker News](Hacker-News) | Scraping a live website | Six steps with screenshots |
|
|
| [Scraping ethics](Scraping-Ethics) | Is web scraping legal and ethical? | The rules we follow, with a screenshot of `robots.txt` |
|
|
| [Top 100 movies](Top-100-Movies) | The 100 movies project | Six steps and `movies.txt` |
|
|
| [What we gained](Gains) | All lectures | A short summary of the skills |
|
|
|
|
## For whom
|
|
|
|
- **Coursists:** readable, runnable code that keeps the assignment's ideas; compare it with your own solution.
|
|
- **Visitors:** a small example with tests and only two runtime dependencies, `requests` and `beautifulsoup4`.
|
|
|
|
The code and the documents are in the [repository](https://git.tirsystem.com/Tirsvad-Udemy-100-days-of-code/045-scrape-movies).
|