Web Scraping Engineer — European Public Procurement We're building the data backbone for European public procurement. Our platform aggregates tender data from 100+ e-procurement portals — each with its own quirks, anti-bot protections, and legacy HTML.We're looking for a scraping engineer who can navigate this landscape: someone who's comfortable with headless browsers, knows how to handle sessions and CAPTCHAs, and won't panic when the same platform serves three different HTML layouts across pages.What you'll doBuild and maintain async scrapers (Python + Playwright) against Italian and later European public procurement portals (Maggioli PortaleAppalti, ANAC, MePA, and others)Handle real-world challenges: JSESSIONID session management, FriendlyCaptcha/Mosparo anti-bot, Cloudflare WAF, IP rotation with rate limit backoffParse Italian data formats — amounts (€ 1.234.567,89), dates (DD/MM/YYYY, textual), CIG/CUP identifiers with placeholder detectionExtract and process documents: PDF, .p7m (PKCS#7 signed), ZIP/7Z archives, with OCR fallbackIntegrate scrapers into our Prefect orchestration pipeline with monitoring, alerting, and anomaly detectionWork with PostgreSQL, Supabase, Clickhouse, and S3 for dual-sink storage with upsert/idempotency patternsWhat we're looking forStrong async Python — you think in asyncio, not time.sleep()Playwright or Selenium experience — you've intercepted XHR responses, handled SPAs, and debugged timing issuesResilience mindset — retry with backoff, graceful degradation, circuit breakers. Your scraper doesn't crash at 3 AM.Comfort with messy HTML — you can write a multi-strategy extractor that handles <th>/<td>, <dt>/<dd>, and <label>/<span> on the same siteData parsing skills — Italian locale, date formats, CIG validation, document type detectionBonus: experience with Italian PA (Pubblica Amministrazione) portals, ANAC/PVL datasets, or OCDS data formatsTech stackPython 3.11+ · Playwright · httpx · BeautifulSoup · Pydantic · SQLAlchemy 2.0 · PostgreSQL · Prefect · AWS S3 · SupabaseHow we hireNo whiteboard algorithms. We'll send you a hands-on technical assessment: a mock procurement portal with real-world challenges. You build a scraper. We evaluate the code.