About
What We Need
A scraper that collects the following data from competitor and marketplace websites:
- Product details – names, descriptions, categories, images, specs
- Pricing & inventory – current prices, sale prices, stock availability, SKUs
- Business/contact info – company names, addresses, emails, phone numbers (where publicly available)
The scraper should target competitor wholesale jewelry sites and relevant marketplace listings. We'll provide the specific URLs and sites to scrape during onboarding.
Technical Requirements
- Scraper must run on a monthly schedule (automated via Cloud Scheduler, cron job, or similar)
- Data must be cleaned, structured, and loaded into our existing BigQuery dataset (we'll provide project access and table schemas, or you can propose a schema)
- Must handle common scraping challenges: pagination, rate limiting, dynamic/JS-rendered pages
- Should include basic error handling and logging so we know if a run fails
- Hosted solution preferred (Google Cloud Functions, Cloud Run, or similar) — we don't want to run anything locally
Deliverables
- Working scraper code (Python preferred)
- Automated monthly scheduling set up and tested
- Data pipeline into BigQuery confirmed working
- Brief documentation covering: how to add/remove target sites, how to monitor runs, and how to troubleshoot failures
Ideal Candidate
-Experience with web scraping (BeautifulSoup, Scrapy, Playwright, or Selenium)
- Familiar with Google Cloud Platform, specifically BigQuery and Cloud Functions/Cloud Run
- Can show examples of similar scraping projects
Good communicator — we want someone who flags issues early rather than going silent
To Apply
Please include in your proposal:
- A brief description of a similar scraping project you've completed
- Your suggested tech stack and approach
- Estimated timeline to completion
- Any questions about the scope
We're looking to move quickly on this — ideally completed within 2–3 weeks of starting.
Contract duration of less than 1 month.
Mandatory skills: Data Scraping, BigQuery, API, Database
Languages
- English
Notice for Users
This job comes from a TieTalent partner platform. Click "Apply Now" to submit your application directly on their site.