Open-Source Meltano/Singer Tap Development (EU only)

via Freelancer ·

Budget / Salary€250–750
TypeFreelance project
LocationRemote
Posted4 hours ago
Project: Build a Meltano/Singer Tap for EDU-V APIs (Open Source) + Integration
About Us
DataOwn is a start-up on a mission to make open source Business Intelligence accessible to more organisations—not just the largest ones. We champion digital autonomy and sovereignty. Because we want to stay true to our mission and never be acquired, we are steward-owned from day one.
We are looking for a self-driven software engineer with a passion for open source and digital sovereignty to join us on a freelance basis. This project is a paid trial assignment that serves as a stepping stone toward a longer-term freelance engagement.
The Project
We need a Meltano/Singer tap (tap-edu-v) that extracts data from 6 REST APIs of the EDU-V platform. The tap will be built using the Meltano Singer SDK (v0.54.5+) and will be released as open source.
Additionally, you will integrate the tap into our existing system and validate end-to-end functionality.
The 6 EDU-V APIs to implement:

association - /api/association
education - /api/education
employee.basic - /api/employee/basic
employee.roles - /api/employee/roles
student.basic - /api/student/basic
organization-units - /api/organization-units

Reference documentation: https://edu-v.atlassian.net/wiki/spaces/AFSPRAKENS/pages/20971561/Consent+API (includes patterns applicable to all APIs)
Reference documentation:
• Meltano Singer SDK: https://sdk.meltano.com/en/v0.54.5/
• EDU-V API documentation: https://edu-v.atlassian.net/wiki/spaces/AFSPRAKENS/pages/20971561/Consent+API
What You'll Build
Using the Meltano Singer SDK and its Cookiecutter template, you will:
1. Scaffold the tap project using the official SDK cookiecutter template
2. Implement (reststream?) subclasses for each of the 6 EDU-V API endpoints
3. Implement authentication — likely API key or OAuth, depending on EDU-V API requirements
4. Configure pagination — implement proper pagination handling
5. Define JSON schemas for each stream based on the EDU-V API response structures
6. Implement incremental replication where applicable (using replication keys and bookmark logic)
7. Write tests — including standard built-in SDK tap tests (pytest)
8. Document the tap — README, configuration schema, and usage examples
9. Publish as open source — prepare the repository for publication (Apache 2.0 license)
Technical structure (based on SDK conventions):

Integration & Testing Environment
We provide:
• Test environment with running EDU-V instance with API credentials
• Docker-based integration test stack:
◦ meltano container (with Singer taps/targets)
◦ postgresql container (target destination for loaded data)
• Integration task — validate that tap-edu-v works end-to-end by:
◦ Running the tap within our Meltano environment
◦ Loading data into PostgreSQL via a Singer target (e.g., target-postgres)
◦ Validating data integrity and completeness
You will need to ensure compatibility with this setup and troubleshoot any issues that arise during integration.
What We Provide
• Test environment — access to a running EDU-V instance with API credentials
• Integration test stack — Docker Compose with Meltano + PostgreSQL
• API documentation — the EDU-V Atlassian Confluence pages describing all 6 APIs
• Code review — feedback from our small but experienced team
• CI/CD expectations — we follow standards for information security and documentation
Requirements
Required skills:
• You must live and work within the European Union. We prefer Romania or The Netherlands / Romanian or Dutch for easyness of communication.
• Several years of experience as a software engineer
• Several years of experience in DevOps
• Exerience with Docker
• Experience with Linux, Bash, and Python
• Familiarity with Terraform
• Affinity with Business Intelligence and data analysis
• Affinity with open source and digital sovereignty
Preferred / Nice-to-have:
• Experience with observability frameworks (Python and/or TypeScript)
• Experience with Kubernetes (future)
• Prior experience contributing to or maintaining open source software
• Experience with BI platforms and ELT pipelines
• Experience with SaaS products and API integrations
• Familiarity with the Singer specification or Meltano ecosystem
Deliverables
1. Working tap-edu-v Python package, installable via pip
2. All 6 EDU-V API streams implemented: association, education, employee.basic, employee.roles, student.basic, organization-units
3. Authentication, pagination, and incremental replication configured
4. Test suite passing (including SDK built-in tap tests)
5. Integration validated with our Docker-based Meltano + PostgreSQL environment
6. Comprehensive README with setup, configuration, and usage instructions
7. Repository prepared for open source publication (Apache 2.0 license)
Long-Term Opportunity
This is a trial project. If the collaboration goes well, we envision a longer-term freelance role within DataOwn where you would:
• Continue building and maintaining open source BI integrations
• Work on API integrations, CLI commands, and frontend component optimisation and expension
• Operate in a small team with short communication lines
• Follow standards for information security and documentation
python linux docker open source devops api integration terraform
Apply on Freelancer →

Project sourced from Freelancer.com. Applications happen directly on the original platform — we never collect your data.