type
entity
created
Tue Apr 07 2026 02:00:00 GMT+0200 (Central European Summer Time)
updated
Tue Apr 07 2026 02:00:00 GMT+0200 (Central European Summer Time)
sources
raw/notes/projectbrief, raw/notes/techContext
tags
scraper crawlee fastapi saas data-collection sibling-project

B2BPaper Scraper

abstract
The B2BPaper Scraper is a sibling project to the main marketplace, built with Crawlee and FastAPI, responsible for data collection from paper industry sources and an in-progress SaaS pivot.

Overview

The B2BPaper Scraper is a separate project that collects data from paper industry sources to feed the marketplace. It lives in its own repository at /home/claude/customers/b2bpaper-scraper/ and is distinct from the main wiki/entities/b2bpaper marketplace application.

Tech Stack

Build Status

The scraper project has its own story-based build tracker:

SaaS Pivot

The scraper project was undergoing a pivot to become a SaaS product -- not just a data collection tool for the marketplace, but a standalone service. This pivot was in progress when development was paused. Key SaaS-related work included:

Relationship to Main Marketplace

The scraper serves as the Data Bootstrap Layer in the wiki/concepts/four-layer-architecture. While the main marketplace handles entity management, matching, and output, the scraper populates the initial data -- product catalogs, mill information, pricing data -- that the marketplace then operates on.

Monitoring

The main marketplace project includes monitoring dashboards for the scraper:

Sources

Related