
Innovation Starts Here
Senior Data Engineer
Share this job
We Are
At Code1 Tech, we drive innovations that shape the future of enterprise technology. Our expertise spans Data Engineering, AI/ML, Cloud Solutions, and Full-Stack Development. We empower businesses with cutting-edge technology solutions, enabling digital transformation at scale. Join us to build impactful products with a passionate team of engineers and innovators.
About The Role
We are seeking a Senior Data Engineer to design, implement, and support end-to-end technical data lineage using Collibra and Snowflake. The role will integrate Snowflake metadata and transformation lineage into Collibra and connect upstream source systems, ETL/orchestration platforms, data-quality tools, and downstream BI applications.
Key Responsibilities:
Lineage design and assessment
- Analyze source-to-report data flows across source systems, ETL tools, Snowflake, Ataccama, and BI platforms.
- Inventory Snowflake databases, schemas, tables, views, columns, procedures, tasks, streams, pipes, and dynamic tables.
- Identify transformation patterns and determine the appropriate lineage-capture method.
- Define table-level and column-level lineage requirements.
- Identify unsupported transformations, metadata gaps, and custom integration requirements.
- Contribute to the target architecture and lineage implementation roadmap.
End-to-end and custom lineage
- Integrate lineage from upstream databases, ETL tools, orchestration platforms, dbt, files, APIs, and downstream BI applications.
- Develop custom metadata extractors, APIs, or lineage payloads for unsupported systems and transformations.
- Integrate relevant Ataccama data-quality rules, scores, issues, and processing metadata with corresponding Collibra assets.
- Support historical lineage, impact analysis, and root-cause investigation requirements.
Mandatory Technical Skills:
- Strong Snowflake architecture, administration and metadata knowledge.
- Experience with Snowflake objects and transformation patterns, including views, stored procedures, tasks, streams, pipes, INSERT SELECT, and MERGE.
- Experience integrating systems through REST APIs, JDBC, JSON, and metadata files.
- Proficiency in Python programming
- Proficiency in REST API integration
- Strong DBMS, SQL skills, and experience analyzing complex transformation logic
Ready to make an impact?
Apply now and join our team of innovators.