Archiving Web Links for Offline Use
Budget / SalaryA$30–250
TypeFreelance project
LocationRemote
Posted8 hours ago
I have a list of 7,002 saved links that I want downloaded and archived so I can browse them offline.
I'll send the list as a CSV with two columns, id and url:
id,url L00001,https://www.instagram.com/reel/DPkXETQE3BM/
L00002,https://www.instagram.com/reel/DNqb6N5x_xW/
Roughly what's in it:
about 4,000 Instagram links (reels, single images, and carousels/slideshows)
about 1,500 Hacker News and Reddit threads
about 1,300 articles and web pages
the rest is YouTube, Wikipedia, eBay, Facebook and assorted other sites
Instagram is half the job and it's the main reason I'm hiring this out rather than doing it myself. I get rate limited within a few minutes doing it by hand in my own browser. Please tell me how you'd handle that at this volume.
WHAT I NEED FOR EACH LINK
the media: the video, the image, or every slide of a slideshow
the caption or article text, in full, not truncated
the comments. Top 50 per item is plenty, I don't need every reply on a huge thread
a snapshot of the page itself if that's straightforward for you
HOW I WANT IT DELIVERED
One folder per link, named with the id from the CSV. Inside each folder: the media files, a metadata.json (url, title, author, date posted, full caption) and a comments.json.
Then one manifest.csv for the whole job, with a row for every id I gave you, whether it worked or not. Columns: id, url, status, files, error. Status should be one of ok, deleted, private, login_required, failed.
The manifest matters more to me than anything else here. If a link is dead or the account is private, just say so, that's a perfectly good answer and I won't hold it against you. What I can't work with is a folder quietly not being there and me not finding out for weeks. The first thing I'll check is whether the manifest has 7,002 rows.
HOW I'D LIKE TO RUN IT
A sample of 33 links first, paid separately. I've picked them to cover the awkward cases: a reel, a slideshow with a specific slide number in the URL, a discussion thread with comments, an ended eBay listing, a Facebook link, a direct image file. If those come back right, I'll send the rest.
The remaining 7000, paid on delivery of each milestone.
DELIVERY AND SIZE
Probably 30 to 80 GB in total, mostly Instagram video. Either you post me a usb, or you upload it somewhere I can download from once. Tell me which suits you and include in price.
PLEASE INCLUDE IN YOUR BID
how you'll handle Instagram at this volume without getting blocked
whether you've done a job this size before, and how long it took
your price for the 33 link sample, and your price for the total 7,002
rough timeline for the whole thing
confirmation that you'll return a manifest row for every id, including the failures
You don't need to organise, rename, tag or categorise anything beyond the id folders. I have my own notes and I'll match everything up at my end. The order doesn't matter either. If a link redirects somewhere unexpected, just note where it ended up and archive what you find there.
I'll send the list as a CSV with two columns, id and url:
id,url L00001,https://www.instagram.com/reel/DPkXETQE3BM/
L00002,https://www.instagram.com/reel/DNqb6N5x_xW/
Roughly what's in it:
about 4,000 Instagram links (reels, single images, and carousels/slideshows)
about 1,500 Hacker News and Reddit threads
about 1,300 articles and web pages
the rest is YouTube, Wikipedia, eBay, Facebook and assorted other sites
Instagram is half the job and it's the main reason I'm hiring this out rather than doing it myself. I get rate limited within a few minutes doing it by hand in my own browser. Please tell me how you'd handle that at this volume.
WHAT I NEED FOR EACH LINK
the media: the video, the image, or every slide of a slideshow
the caption or article text, in full, not truncated
the comments. Top 50 per item is plenty, I don't need every reply on a huge thread
a snapshot of the page itself if that's straightforward for you
HOW I WANT IT DELIVERED
One folder per link, named with the id from the CSV. Inside each folder: the media files, a metadata.json (url, title, author, date posted, full caption) and a comments.json.
Then one manifest.csv for the whole job, with a row for every id I gave you, whether it worked or not. Columns: id, url, status, files, error. Status should be one of ok, deleted, private, login_required, failed.
The manifest matters more to me than anything else here. If a link is dead or the account is private, just say so, that's a perfectly good answer and I won't hold it against you. What I can't work with is a folder quietly not being there and me not finding out for weeks. The first thing I'll check is whether the manifest has 7,002 rows.
HOW I'D LIKE TO RUN IT
A sample of 33 links first, paid separately. I've picked them to cover the awkward cases: a reel, a slideshow with a specific slide number in the URL, a discussion thread with comments, an ended eBay listing, a Facebook link, a direct image file. If those come back right, I'll send the rest.
The remaining 7000, paid on delivery of each milestone.
DELIVERY AND SIZE
Probably 30 to 80 GB in total, mostly Instagram video. Either you post me a usb, or you upload it somewhere I can download from once. Tell me which suits you and include in price.
PLEASE INCLUDE IN YOUR BID
how you'll handle Instagram at this volume without getting blocked
whether you've done a job this size before, and how long it took
your price for the 33 link sample, and your price for the total 7,002
rough timeline for the whole thing
confirmation that you'll return a manifest row for every id, including the failures
You don't need to organise, rename, tag or categorise anything beyond the id folders. I have my own notes and I'll match everything up at my end. The order doesn't matter either. If a link redirects somewhere unexpected, just note where it ended up and archive what you find there.
Apply on Freelancer →
Project sourced from Freelancer.com. Applications happen directly on the original platform — we never collect your data.