Intelligence · Component · cruise-provider-crawling
Cruise itinerary, fare and ship crawling
What it does
Browser crawlers collect voyages, fares/offers, suite/cabin details, itineraries and ship amenities from Silversea, Explora Journeys and Swan Hellenic, with batch/progress handling.
Core pattern
Browser batch collection + structured details and progress
- Input
- Provider pages and URL spreadsheets
- Output
- Cruise/ship JSON, updated spreadsheets and crawl progress
Key parameters
| Name | Type | Default | Values |
|---|---|---|---|
| provider | — | — | — |
| source_urls_workbook | — | — | — |
| start_index | integer | 0 | 0–1000000 |
| batch_size | integer | 20 | 1–1000 |
| max_cruises_workers | — | — | — |
Maturity and limits
Provider-specific extraction methods and batch/update variants accompany saved crawl records; selectors were not live-tested. Static source inspection only; no runtime, provider, deployment or test-pass claim.
Provider terms, image/content rights, fragile DOM selectors and dated cached fares; no root license.
Used in pipelines
Industry tags
- Travel & hotelsSource-supported industry
For work involving destinations, room rates and bookings, use browser batch collection followed by structured details and progress.
- Manufacturing & industryTransferable use
For unified lookup of spare-part catalogs and equipment records, use browser batch collection followed by structured details and progress.
Skills pack
Contract scaffold and deterministic mock
Download · 11KBSHA-256 65419c021ae86d2064f44f1d97fecb3757dd9316276a441ab5574fb6b6c715af
Related components
-
Image and text product similarity search
Shared image-text retrieval + similarity tiers and attribute filters
Working 1 pipeline -
Hotel benefit evidence and comparison
Side-by-side benefit facts + commitment status distinction
Working 1 pipeline -
Multilingual hybrid retrieval and online reindexing
Multi-route retrieval fusion + access filters and index switching
Working not yet in a pipeline -
Travel master and inventory synchronization
Upstream record staging + import audits and snapshots
Working 1 pipeline