**English** · [Dansk](Home-da) · [Bahasa Melayu](Home-ms)

# scrape-movies wiki

Day 45 of Udemy's "100 Days of Code: The Complete Python Pro Bootcamp" is about web scraping with Requests and BeautifulSoup. This repository reproduces every lecture step as tested Python code. This wiki shows each step with a screenshot and explains what we gained from it.

## Pages

| Page | Lecture | What you get |
| --- | --- | --- |
| [Setup](Setup) | - | Create the `.venv`, install, run the tests |
| [Parsing HTML](Parsing-HTML) | Parsing HTML and making soup; finding and selecting elements | Five steps with screenshots |
| [Hacker News](Hacker-News) | Scraping a live website | Six steps with screenshots |
| [Scraping ethics](Scraping-Ethics) | Is web scraping legal and ethical? | The rules we follow, with a screenshot of `robots.txt` |
| [Top 100 movies](Top-100-Movies) | The 100 movies project | Six steps and `movies.txt` |
| [What we gained](Gains) | All lectures | A short summary of the skills |

## For whom

- **Coursists:** readable, runnable code that keeps the assignment's ideas; compare it with your own solution.
- **Visitors:** a small example with tests and only two runtime dependencies, `requests` and `beautifulsoup4`.

The code and the documents are in the [repository](https://git.tirsystem.com/Tirsvad-Udemy-100-days-of-code/045-scrape-movies).