Tirsvad-Udemy-100-days-of-code/048-scrapping-wiki
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
Page: Setup and Run
Pages
Docker Testing da Docker Testing ms Docker Testing Home da Home ms Home Lecture Steps da Lecture Steps ms Lecture Steps Setup and Run da Setup and Run ms Setup and Run
Clone
1
Setup and Run
Tirsvad edited this page 2026-10-28 09:30:43 +01:00
Table of Contents

Setup and Run

🌐 English · Dansk · Bahasa Malaysia

Requirements

  • Python 3.13 or newer
  • Google Chrome (Selenium downloads the matching driver)
  • Optional: Docker, for the end to end run; Doxygen, for the API documentation

Create and use a local .venv

python -m venv .venv

Activate it:

# Windows (PowerShell)
.venv\Scripts\Activate.ps1

# Windows (Git Bash)
source .venv/Scripts/activate

# Linux / macOS
source .venv/bin/activate

Upgrade pip and install the project with the test tools:

python -m pip install --upgrade pip
python -m pip install -e ".[dev]"

Leave the environment with deactivate.

Run

python -m scraping_wiki.interaction

Chrome opens, loads the Wikipedia main page, the article count is printed and the browser closes. Add --headless to run without a window:

scraping-wiki --headless

Tests

python -m pytest
python -m ruff check src tests
python -m mypy src tests

The unit tests use a fake driver and start no browser. For the end to end run see Docker Testing.

API documentation

doxygen Doxyfile

The HTML is written to docs/doxygen/html.

Scraping Wiki

Related

Languages