Data Engineer

• Remote, contract role
• East Coast working hours

RedStream Technology is recruiting for a Data Engineer to work with our client, a premier global management firm.  The team is focused on analyzing existing data, develop measures, and build machine learning and AI models to enhance knowledge management workflows.

Primary Objectives

• Support the Knowledge Management Function by developing data pipelines and enabling effective knowledge curation.
• Facilitate the integration of knowledge assets into GenAI solutions by optimizing the knowledge platform.
• Develop tools to identify knowledge gaps proactively (e.g., determining areas with insufficient information).

Team Dynamics

• The team includes internal members already working on the project, but they need to accelerate progress on specific workstreams.
• Looking for a candidate with extensive experience who can work independently and take ownership of workstreams without requiring close guidance.

Key Responsibilities

• Coding-intensive role (no design work).
• Help build tools that ensure document compatibility with machine learning (e.g., assessing how PowerPoint formatting affects ML readiness).
• Analyze and process knowledge assets to enhance machine compatibility and usability.

Technical Requirements

• Programming: Python and SQL, with familiarity in APIs and GenAI tools.
• Data Storage: Experience with Snowflake (a plus).
• Pipelines: Proficiency in building both cloud-based (AWS) and traditional pipelines.
• Hands-on experience in coding and pipeline development.