Python Developer for Web Scraping Investigation

via Freelancer ·

Budget / Salary₹40,000–45,000
TypeFreelance project
LocationRemote
Posted1 hour ago
We are looking for an experienced Python Web Scraping / HTTP Request Developer to investigate a response issue with the Temu website.

Website: https://www.temu.com/

The task is only to investigate the response issue and identify the root cause.

The required flow is:

* First open the Temu website
* Navigate to **Categories**
* Identify and collect all required categories
* For each category, identify all available products
* Handle category page pagination / "Load More" functionality
* Verify that the correct product response is returned for each category and product page

The developer should:

* Analyze the existing request flow
* Check the required request parameters
* Check headers, cookies, session values, and other relevant request components
* Identify why the response is incorrect or incomplete
* Provide the required technical changes to obtain the correct response

### Scraping Requirements

The scraper should support:

* All required category/listing page extraction
* Product detail page extraction
* Category pagination / "Load More" functionality
* All products available under the required categories
* Correct and consistent product responses

Temu pages can contain dynamically loaded content, so the developer should analyze the required HTTP requests and determine how to obtain the correct response through the request method.

The developer should first create a working proof of concept for a selected category and demonstrate that the required product fields are returned correctly before scaling the solution.

### Notes

* **Only the HTTP request/response method is required.**
* **Do not use Selenium or Playwright.**
* We will manage additional requirements such as **proxy, server, and infrastructure** from our side.
* The main requirement is to identify and resolve the **request/response issue** and provide the working request method.
python web scraping data extraction api
Apply on Freelancer →

Project sourced from Freelancer.com. Applications happen directly on the original platform — we never collect your data.