Remote Data Engineer Job at Software Technology Inc, Washington DC

  • Software Technology Inc
  • Washington DC

Job Description

Remote Data EngineerKey Responsibilities:Designs and automates deployment of our distributed system for ingesting and transforming data from various types of sources (relational, event-based, unstructured).Designs and implements framework to continuously monitor and troubleshoot data quality and data integrity issues.Implements data governance processes and methods for managing metadata, access, retention to data for internal and external users.Designs and provide guidance on building reliable, efficient, scalable and quality data pipelines with monitoring and alert mechanisms that combine a variety of sources using ETL/ELT tools or scripting languages.Designs and implements physical data models to define the database structure.Optimizing database performance through efficient indexing and table relationships.Participates in optimizing, testing, and troubleshooting of data pipelines.Designs, develops and operates large scale data storage and processing solutions using different distributed and cloud based platforms for storing data (e.g. Data Lakes, Hadoop, Hbase, Cassandra, MongoDB, Accumulo, DynamoDB, others).Uses innovative and modern tools, techniques and architectures to partially or completely automate the most-common, repeatable and tedious data preparation and integration tasks in order to minimize manual and error-prone processes and improve productivity.Assists with renovating the data management infrastructure to drive automation in data integration and management.Ensures the timeliness and success of critical analytics initiatives by using agile development technologies such as DevOps, Scrum, Kanban Coaches and develops less experienced team membersSkillset:Hands-on Azure Data experienceTools to have: Databricks, Synapse, Data Factory, etc.

Job Tags

Similar Jobs

SnapCare

Travel Surgical Tech in Springfield, OR Job at SnapCare

Surgical Tech Location: Springfield, OR Agency: SnapCare Pay: Competitive weekly pay (inquire for details) Shift Information: Rotating Start Date: ASAP About the Position N/A Requirements N/A

City of Wilmington

EQUIPMENT OPERATOR (STREET CLEANING) Job at City of Wilmington

 ...position(s).Type: Open CompetitiveThe City of Wilmington, a leading Delaware employer, provides the City's sanitation, recycling, street cleaning, water, and transportation services through the Department of Public Works. The Department provides a wide array of services,... 

Prime Healthcare

Orthopedic Spine Surgeon Job at Prime Healthcare

 ...Overview Orthopedic Spine Surgeon Saint Joseph Medical Center | Joliet, Illinois Prime Healthcare is seeking a Board Certified/Board Eligible Orthopedic Spine Surgeon to join a thriving orthopedic program at Saint Joseph Medical Center in Joliet, Illinois... 

North American Construction Group

Safety Manager Job at North American Construction Group

 ...Safety Manager Position We are seeking a Safety Manager to lead health and safety initiatives at the San Miguel Lignite Mine in...  ...your future forward. Our people are what make North American Construction Group an industry leader, it's our people that keep our expansive... 

Wyndy LLC

Trusted Infant nanny near Job at Wyndy LLC

 ...Trusted Infant nanny needed for a reliable and responsible caregiver. Experience in infant care required. Must have a valid driver's license and clean background check. CPR and First Aid certification preferred. Flexible availability during evenings and weekends. Efficiently...