Python App Performance Optimization

I need an experienced Python-side performance specialist to push a sluggish, newly built application to acceptable speeds. The code currently trawls through 2.5 billion rows spread over 50 databases and roughly 250 tables; about half of those rows are duplicates that have crept in during successive imports. Even on a 32 GB RAM / 2 TB SSD machine the application stalls during data retrieval, heavy processing and, by extension, the user interface. Because we query and update the data once every day, I must have an optimisation that keeps daily runs well within our limited maintenance window.

You will connect over TeamViewer, AnyDesk or UltraViewer (whichever is most convenient) and work within a tight budget that has already absorbed most of the development cost. Preference goes to Indian professionals or firms as this aligns best with our time zone and compliance requirements.

Key objectives
• Analyse current Python code paths, SQL calls and indexing strategy, then provide a concise optimisation plan.
• Remove or otherwise handle the ~50 % duplicate records without data loss for legitimate marketing analytics.
• Tune or migrate the underlying data store—partitioning, indexing or sharding—so that retrieval, processing and UI response are measurably faster.
• Deliver fully tested code or scripts plus a short hand-over note explaining how to maintain the improved setup.

Acceptance criteria
1. End-to-end daily job completes inside the agreed time budget and uses no more than the existing 32 GB RAM.
2. Interactive screens return results within a user-perceived two-second threshold.
3. Duplicate-removal logic passes sample spot checks for accuracy.
4. Hand-over document is clear enough for an internal developer to repeat the process.

If you are confident you can hit these marks inside our 15 k INR ceiling, let’s start immediately—the sooner the data flows, the better our campaigns perform.