Fundable - Senior Data Engineer
silver
Job Score
100 ptsAbout Fundable
Fundable is a startup data platform that helps investors and other teams discover and research companies. We bring together information on companies, investors, funding activity, and people to make that research easier.
Role overview
We’re looking for a senior data engineer to own Fundable’s data platform from architecture through production, reliably turning high volumes of data from provider APIs, webhooks, files, and web scraping into trusted records for our products.
Today, our enrichment and extraction workflows largely run serially inside a container. You’ll lead the move to a platform that supports concurrent processing, event-driven intake, and orchestrated batch workflows.
What you’ll own
Multi-source intake: Build concurrent ingestion for provider APIs, webhooks, files, and scraping, with rate limits and failure handling.
Batch and event-driven execution: Orchestrate scheduled workflows and historical backfills using tools such as Airflow, Dagster, or Prefect. Build event-driven intake with Pub/Sub or Cloud Tasks, including retries, dead-letter queues, and controlled replay of failed work.
Raw-to-curated data: Preserve original payloads, including provider JSON, in Google Cloud Storage (GCS) before transforming them with dbt. Establish medallion layers for raw, standardized, and curated data.
Correctness through recovery: Implement idempotent upserts and safe retries, replay, and historical backfills that avoid duplicate records or data corruption. Make data traceable to its source and safe to reprocess.
Data quality and delivery: Define data contracts, build automated validation and pipeline tests, and monitor freshness and failures. Design and optimize PostgreSQL schemas, queries, and loading patterns so downstream products receive dependable data.
Extraction and enrichment: Integrate provider enrichment and LLM-based structured extraction from text into the platform.
Must-have experience
Experience building multi-source production data platforms from zero to one, from initial architecture and pipeline implementation through deployment and ongoing operation.
Production experience with workflow orchestration tools such as Airflow, Dagster, Prefect, or Temporal, including dependencies, retries, and failure recovery. Airflow experience is preferred.
Hands-on production experience with dbt and GCP.
Experience building event-driven systems with messaging or task queues, including asynchronous processing and failure recovery.
Strong SQL and PostgreSQL skills, including data modeling, query optimization, and reliable incremental loading. Experience with data contracts, raw and curated storage, retention policies, and automated quality checks.
Strong Python skills, including asynchronous HTTP and concurrent processing with tools such as asyncio, aiohttp, or HTTPX.
Hands-on web scraping experience with tools such as Scrapy, Playwright, Selenium, or Beautiful Soup, including concurrent scraping, rate limits, and failure handling.
Nice-to-have experience
Experience working in startups or small engineering teams, with broad ownership and changing priorities.
Entity resolution experience is especially valuable: matching company and people records across sources and reconciling duplicates into consistent entities.
LLM-based structured extraction or company and people data enrichment.
Familiarity with BigQuery and Dataform.
Interview Process
Silver Screening Interview
Offline Case Study
Client Behavioral Interview
Client Case Study Interview
Client Final Round Interview
About Data
The Data field has undergone a radical transformation with the rise of Generative AI. Data professionals are fundamental for evidence-based decision-making across all industries.
Key specializations include Data Engineering, Data Science, Business Intelligence, Machine Learning Engineering, and Analytics. Tools like SQL, Python, Spark, dbt, and cloud platforms (AWS, GCP, Azure) are essential.
The data market continues with high demand and salaries among the most competitive in the technology sector, with many remote work opportunities.
Discover Other Areas
Understand the scope of work, key skills, and tools used in different career areas.
About Scrum Master
The Scrum Master is the professional responsible for facilitating the adoption of Scrum and agile practices within development teams. They act as servant leaders, removing impediments, promoting continuous improvement, and ensuring Scrum events and ceremonies happen in the best possible way.
Key skills include event facilitation (sprint planning, daily, review, retrospective), backlog management, team coaching, conflict resolution, and agile metrics (velocity, burndown, cycle time). Knowledge of Jira, Trello, Azure DevOps, and frameworks like Kanban, XP, and SAFe is a differentiator.
Scrum Masters in technology companies are highly valued, especially those who can promote team autonomy, create psychologically safe environments, and lead agile transformations at scale. The field offers opportunities from junior scrum master to agile coach, head of agile, and director of agile transformation.
About Product Owner
The Product Owner (PO) is the professional responsible for maximizing the value of the product delivered by the development team. They act as the voice of the customer and stakeholders, managing and prioritizing the product backlog, defining clear user stories, and ensuring the team works on the most valuable items for the business.
Key skills include backlog management, user story writing, prioritization (Mascow, RICE), agile methodologies (Scrum, Kanban), and stakeholder communication. Knowledge of tools like Jira, Trello, Azure DevOps, and Miro is essential.
Product Owners are highly sought-after professionals in the technology market, working collaboratively with Scrum Masters, Product Managers, and engineering teams to drive agility and continuous value delivery.
About Project Manager
The Project Manager is the professional responsible for planning, executing, and controlling projects end-to-end, ensuring they are delivered on time, within budget, and with the expected quality. With the growing complexity of businesses, project management professionals are fundamental to organizational success.
Key skills include planning and scheduling, scope, cost, risk, quality, and resource management, stakeholder communication, cross-functional team leadership, and use of agile and traditional methodologies. Certifications like PMP, PRINCE2, and Six Sigma are important differentiators.
Project Managers in technology companies are highly valued, especially those who master agile methodologies (Scrum, Kanban), tools like Jira and MS Project, and can deliver complex projects efficiently. The field offers opportunities from project analyst to head of PMO, with a focus on execution, governance, and business value.
About Blockchain
The Blockchain area involves the development and implementation of secure and distributed transaction ledgers. Professionals in this field work with smart contract development, cryptography, consensus algorithms, and platforms such as Ethereum, Hyperledger, and Solana, ensuring security and decentralization for various types of applications.
About Backend
The Backend area is responsible for all server logic, APIs, databases, and infrastructure that support web and mobile applications. Backend professionals ensure that systems are scalable, secure, and performant.
Key skills include languages like PHP, Java, Python, Ruby, Go, and Node.js, frameworks like Laravel, Spring Boot, Django, and Express, databases (MySQL, PostgreSQL, MongoDB, Redis), software architecture (clean architecture, DDD, microservices), and API security (OAuth, JWT).
Backend developers in technology companies are highly valued, especially those who master microservices architecture, cloud computing, and high-scale performance. The field offers opportunities from junior developer to software architect, with a focus on scalability, security, and efficiency.
Comments 0