Tirsvad-Udemy-100-days-of-code/047-amazon-price-tracker
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
Page: Step 3 Request Headers
Pages
Home da Home ms Home Step 1 Scrape the Price da Step 1 Scrape the Price ms Step 1 Scrape the Price Step 2 Email Alert da Step 2 Email Alert ms Step 2 Email Alert Step 3 Request Headers da Step 3 Request Headers ms Step 3 Request Headers Step 4 Live Amazon da Step 4 Live Amazon ms Step 4 Live Amazon
Clone
1
Step 3 Request Headers
Tirsvad edited this page 2026-10-28 07:51:26 +01:00
Table of Contents

Step 3: request headers

🌐 English · Dansk · Bahasa Melayu

Assignment. Send browser-like headers with the request: at least User-Agent and Accept-Language.

What we built. DEFAULT_HEADERS in constants.py (without Host and X-Amzn-Trace-Id) and RequestsPageFetcher, which passes them as headers= to requests.get.

What a browser sends to httpbin.org/headers, and what the bot sends (Host is added by requests):

Headers sent by a browser

Headers sent by the bot

What we gained

  • A request carries more than the URL: the browser, the system and the language travel in headers.
  • With the right headers a server can answer in your language and currency.
  • A script without headers looks like a bot, and many servers block bots.
  • One read-only definition of the headers, and tests that check what is sent.

Amazon Price Tracker

Languages