Job at a glance
Job Type Full-TimeOverviewThe Princeton DMIA Integration team is looking for a Data Engineer to own and evolve our data integration practice. You will be responsible for ingesting data from enterprise source systems into our data warehouse platform — what the CIO office refers to as system-to-data-repository integrations. You will play a key role in our migration to a cloud-native data platform, with candidates expected to bring expertise in modern tooling such as Microsoft Fabric, Snowflake with dbt and Fivetran, or Databricks.
The existing data warehouse technologies include IBM DataStage, SQL, Oracle, and Shell-based pipelines running on on-premises Linux infrastructure.ResponsibilitiesArchitect, Design, Develop:Design, build, and maintain ETL/ELT pipelines to ingest, transform, and load data from source systems into the enterprise data warehouse.Lead the migration of on-premises data pipelines to the organization’s future cloud-native data platform (one of Fabric, Snowflake + dbt + Fivetran, or Databricks).Implement and enforce data quality checks, data lineage tracking, and pipeline observability across all integration workflows.Ensure data security and compliance requirements are met, including encryption at rest and in transit, and access controls aligned with IAM policies.Optimize pipeline performance, scheduling, and resource utilization across batch and incremental load patterns.
Collaborate and Coordinate:Partner with data analysts, BI developers, and source system owners to understand data requirements and translate them into robust ingestion pipelines. Production Support:Operate and support ingestion and transformation pipelines.Develop and maintain data pipeline documentation, data dictionaries, and SLA agreements for ingestion jobs.Participate in on-call production support rotation and respond to integration incidents per SLA.Contribute to CI/CD pipeline setup and DevOps practices for data integration deployments.QualificationsEssential Qualifications:CORE SKILLSLinux / Shell scriptingPython programmingSQL (query authoring and data validation)Basic networking (DNS, HTTP/S, TCP/IP, proxies, firewalls)Cloud infrastructure fundamentals (any major provider)IAM: LDAP, Active Directory, OAuth 2.0, certificate management5+ years of proven experience with enterprise ETL/ELT toolingAdvanced SQL skills across multiple platforms (Oracle, SQL Server, PostgreSQL)Strong Python programming skills for data transformation, scripting, and pipeline automationShell scripting proficiency for batch job automation on Linux/Unix serversHands-on experience with at least one cloud data platform: Microsoft Fabric, Snowflake (with dbt and/or Fivetran), or DatabricksExperience with dbt (data build tool) for transformation layer developmentLinux/Unix systems fluency including file management, cron scheduling, and process monitoringUnderstanding of data warehousing concepts: dimensional modelling, star/snowflake schemas, slowly changing dimensionsFamiliarity with basic networking, storage, and cloud infrastructure conceptsExperience with IAM and access control: LDAP, Active Directory, and database-level permission managementWorking knowledge of REST APIs for source system data extraction and pipeline orchestrationAbility to document data flows, pipeline architecture, and transformation logic clearlyEducation: Bachelor’s degree in computer sciencePreferred Qualifications:7+ years proven experience with enterprise ETL/ELT toolingFamiliarity with orchestration tools such as Apache Airflow, Azure Data Factory, or PrefectExposure to streaming or near-real-time ingestion patterns (Kafka, Kinesis, Event Hubs)Experience with data quality frameworks (Great Expectations, Soda, or equivalent)Cloud platform certifications (Azure, AWS, or GCP data engineering tracks)Princeton University is an Equal Opportunity Employer and all qualified applicants will receive consideration for employment without regard to age, race, color, religion, sex, sexual orientati