This job offer is no longer available
About
We are hiring an experienced AI focused software developer to build a system that scrapes, processes, and organizes real time public information from the internet into a structured intelligence feed.
The goal is to create an automated interface that continuously collects data, applies AI based filtering and classification, and outputs clean, usable intelligence.
This is a technical build project focused on architecture, scraping pipelines, and AI assisted data processing.
Scope of Work
Design a real time web scraping system
Build automated pipelines to collect data from multiple public sources
Apply AI or LLM tools to extract structured information from raw text
Create filtering and categorization logic
Store and organize incoming data in a database
Build a backend interface or API for accessing the intelligence feed
Optimize reliability and performance
Provide documentation for deployment and maintenance
Deliverables
Working scraping engine running in real time
AI assisted data processing pipeline
Structured database schema
Backend interface or API endpoint
Deployment instructions
Technical documentation
Required Skills
Python or
Web scraping (Scrapy, Playwright, Puppeteer, Selenium, or similar)
API integration
AI or LLM integration
Database design (SQL or NoSQL)
Cloud deployment experience
Backend architecture
Preferred Experience
Real time data pipelines
NLP or automated text classification
Streaming or event based systems
Building production scraping systems
Performance optimization
Project Type
One time build project with potential for ongoing work if successful.
Contract duration of 3 to 6 months. with 30 hours per week.
Mandatory skills: Artificial Intelligence, API, Python, Machine Learning, Artificial Neural Network, JavaScript, TensorFlow, C++, Java
Languages
- English
Notice for Users
This job was posted by one of our partners. You can view the original job source here.