bags · Jul 20–25, 2020 · v0.4–v0.5.1 · via commits

FWRD shoes, dresses and bags, multi-image tweets

The scraper grew from one retailer to four FWRD and Coach feeds, with each feed tweeting from its own pool and richer multi-image posts.

Added 6

  • FWRD dresses and bags categories
  • Up to four images per tweet
  • Price filter excluding products over $1000
  • Category selectable via environment variable
  • FWRD shoes as a second retailer
  • Category system with per-feed product selection

Changed 6

  • Logging through ILogger instead of the console
  • Category-specific image sizing in a dedicated ImageProcessor
  • Database operations moved into DatabaseContext
  • FWRD parsed from its lazy-load API with AngleSharp
  • Variable-width images keep their aspect ratio
  • Retailer scraping split into page object models

Fixed 1

  • Crash on FWRD products without a sale price