Engineer Data Iii

Data Engineer III

Seattle, WA / Rocket City, FL / Huntsville, AL

Contract Position

Responsibilities:

• Drive the practice of federating data ingestion, curation, and hydrating the ontology within our Palantir Foundry platform.

• Guide the definition of common standards for data pipelines, ensuring high data quality, robust Role-Based Access Control (RBAC), and precise data classification.

• Create patterns and standards for Change Data Capture (CDC), incremental loads, and streaming data within the platform.

• Lead the design and implementation of DevOps practices, data platform monitoring, and observability to ensure operational excellence and high availability of data services.

• Need to solution & implement complex data pipelines orchestration for a knowledge graph build.

• Federate Data Ingestion and Curation:
  • Lead the efforts to streamline data ingestion and curation processes, ensuring efficient and scalable data handling within the Palantir Foundry platform.
• Hydrate Ontology:
  • Spearhead the development and maintenance of the ontology, facilitating a structured and intuitive understanding of the data landscape.
• Define Data Pipeline Standards:
  • Establish common standards for data pipelines, focusing on data quality, RBAC, and data classification to maintain integrity and security.
• Develop Data Patterns and Standards:
  • Create and implement patterns and standards for CDC, incremental loads, and real-time data streaming, enhancing the platforms responsiveness and flexibility.
• Lead Ontology Build:
  • Guide the construction of the ontology, ensuring it meets the complex needs of aerospace manufacturing data.
• Mentor Data Engineers:
  • Provide leadership and mentorship to other data engineers, promoting the adoption of standards, patterns, and DataOps practices for federating data pipeline work across the enterprise.
• Accelerate Delivery and Self-Service:
  • Drive the acceleration of data pipeline delivery and promote data self-service consumption, enabling faster decision-making and innovation.
• DevOps Practices:
  • Design and implement DevOps practices for data operations, ensuring continuous integration, continuous delivery, and automated testing are at the core of the data engineering workflow.
• Monitoring and Observability:
  • Establish comprehensive monitoring and observability frameworks for the data platform, enabling proactive issue detection and resolution to maintain high service availability.

Qualifications:

• Bachelors or Masters degree in Computer Science, Data Engineering, or a related field.
• 5-8 years required in the data engineering & data management with a strong focus on data platforms like Databricks, Snowflake or Palantir Foundry
• Extensive knowledge of data ingestion, ETL processes, and data modeling.
• Strong problem-solving skills and the ability to work with complex data integration challenges.
• Experience with data reconciliation, data pipeline & data monitoring, and performance optimization.
• Excellent communication and teamwork skills
• Leadership experience and the ability to mentor junior engineers.
• Prior experience in aerospace manufacturing or a related industry is a plus
• Ability to earn trust, maintain positive and professional relationships, and contribute to a culture of inclusion

• Technology Stack Experience:

  • Programming Languages - Python, PySpark, Java, SQL
  • Databases - Postgres, Oracle
  • Cloud Services – AWS, Azure, GCP (storage, compute, databases, catalogs, streaming, replication, Queueing & Notification, Logging & Monitoring service) – any one of the cloud platforms is good but AWS is preferred.
  • Big Data Frameworks
  • Metadata Catalogs – DataHub, Informatica, Collibra (experience in any one is good)
  • Data Quality Platforms – Anomolo, Informatica, BigEye (experience in any one is good)
  • Event Platforms – Kafka, MSK
  • Data Platforms – Palantir Foundry, Databricks, Snowflake (experience in any one is good but Foundry experience will be a bonus)

• Applicants selected for employment will be required to pass a pre-employment drug screening and background investigation which may include education, criminal and work history verifications.
• Accepted applicants will have the opportunity to be eligible for benefits, including medical and supplemental insurance and a 401K. Appreciation and gratitude for employees is a hallmark of organizations with low turnover.

Moseley Technical Services, Inc. is an AA/EEO/Veterans/Disabled Employer.

Resources

To apply, send resume to: resumesmoseleytechnical.com

For more active job openings: http://www.moseleytechnical.com

For more information about Moseley visit: http://www.moseleytechnical.com/about-us/