Azure VM Environment & Website Scrapper Expertise
Budget / Salary$750–1,500
TypeFreelance project
LocationRemote
Posted1 hour ago
## Retail Scraper & Anti-Automation Expertise — Required
In addition to completing and stabilizing the existing Azure multi-VM environment, the selected engineer must be capable of inspecting, diagnosing, repairing, and maintaining the existing extraction systems for:
- Walmart
- Target
- Jewel-Osco
- Mariano’s / Kroger
These are established production-oriented scrapers, not greenfield assignments. The engineer must be comfortable determining whether a failure originates from the scraper, browser/session environment, network/proxy configuration, Azure infrastructure, retailer data endpoints, or retailer-side anti-automation controls.
Strong practical experience is required with modern retail protection environments, including technologies and techniques associated with:
- Akamai Bot Manager / Akamai edge protections
- HUMAN Security / PerimeterX-style bot defenses
- Web Application Firewalls (WAF)
- browser and device fingerprinting
- TLS/client fingerprint consistency
- behavioral and session-based detection
- IP/network reputation
- cookies and browser-session continuity
- silent blocking and degraded responses
- XHR/fetch/JSON/GraphQL endpoint analysis
- Chrome DevTools and HAR/network analysis
- Playwright, Chrome and CDP
- proxy routing and leak diagnosis
The engineer should understand that successful HTTP status codes do not necessarily mean successful extraction. Retail defenses may present as zero products, incomplete categories, missing fields, degraded responses, changed payloads, or other silent failures.
The engineer must be able to compare known-good and failing behavior, identify the responsible layer with evidence, and make targeted corrections without unnecessarily rewriting working scraper logic.
Experience with large retail/e-commerce sites protected by Akamai, HUMAN/PerimeterX, or comparable enterprise bot-management systems should be described specifically in the proposal.
### Proposal Requirement
Please identify which of the following you have personally worked with and briefly describe the work performed:
1. Akamai-protected retail/e-commerce sites
2. HUMAN/PerimeterX-protected sites
3. Playwright or Chrome/CDP automation under bot-management controls
4. Silent/degraded-response detection
5. Browser/session fingerprint isolation across multiple workers
6. XHR/fetch/API endpoint discovery using DevTools or HAR analysis
7. Multi-VM or multi-worker browser automation in Azure
Please distinguish direct hands-on experience from general familiarity.
In addition to completing and stabilizing the existing Azure multi-VM environment, the selected engineer must be capable of inspecting, diagnosing, repairing, and maintaining the existing extraction systems for:
- Walmart
- Target
- Jewel-Osco
- Mariano’s / Kroger
These are established production-oriented scrapers, not greenfield assignments. The engineer must be comfortable determining whether a failure originates from the scraper, browser/session environment, network/proxy configuration, Azure infrastructure, retailer data endpoints, or retailer-side anti-automation controls.
Strong practical experience is required with modern retail protection environments, including technologies and techniques associated with:
- Akamai Bot Manager / Akamai edge protections
- HUMAN Security / PerimeterX-style bot defenses
- Web Application Firewalls (WAF)
- browser and device fingerprinting
- TLS/client fingerprint consistency
- behavioral and session-based detection
- IP/network reputation
- cookies and browser-session continuity
- silent blocking and degraded responses
- XHR/fetch/JSON/GraphQL endpoint analysis
- Chrome DevTools and HAR/network analysis
- Playwright, Chrome and CDP
- proxy routing and leak diagnosis
The engineer should understand that successful HTTP status codes do not necessarily mean successful extraction. Retail defenses may present as zero products, incomplete categories, missing fields, degraded responses, changed payloads, or other silent failures.
The engineer must be able to compare known-good and failing behavior, identify the responsible layer with evidence, and make targeted corrections without unnecessarily rewriting working scraper logic.
Experience with large retail/e-commerce sites protected by Akamai, HUMAN/PerimeterX, or comparable enterprise bot-management systems should be described specifically in the proposal.
### Proposal Requirement
Please identify which of the following you have personally worked with and briefly describe the work performed:
1. Akamai-protected retail/e-commerce sites
2. HUMAN/PerimeterX-protected sites
3. Playwright or Chrome/CDP automation under bot-management controls
4. Silent/degraded-response detection
5. Browser/session fingerprint isolation across multiple workers
6. XHR/fetch/API endpoint discovery using DevTools or HAR analysis
7. Multi-VM or multi-worker browser automation in Azure
Please distinguish direct hands-on experience from general familiarity.
Apply on Freelancer →
Project sourced from Freelancer.com. Applications happen directly on the original platform — we never collect your data.