Data Engineer Job at Soft source inc, Houston, TX

Y1RPU3AzUXdJbVlPRmdTdmU2Z1NLaEo1ZlE9PQ==
  • Soft source inc
  • Houston, TX

Job Description

Key Responsibilities:
  • Design and maintain robust, secure, and high-performance data pipelines to support DAISY's processing and analytics workflows

  • Implement authentication and authorization mechanisms to secure data access and movement

  • Work with both SQL and NoSQL databases to store and retrieve structured and unstructured data efficiently

  • Apply data caching and optimization strategies to improve application responsiveness and system performance

  • Build, deploy, and manage containerized applications using Docker

  • Collaborate with developers, architects, and security teams to ensure system compliance and performance

  • Troubleshoot pipeline and infrastructure issues in development and production environments

  • Contribute to architecture discussions and make recommendations for technology direction

Required Qualifications:
  • 5+ years of experience in data engineering or backend data development

  • Strong hands-on experience in building data pipelines (ETL/ELT) for high-volume systems

  • In-depth knowledge of data security , authentication , and authorization strategies

  • Experience with SQL databases (e.g., PostgreSQL, SQL Server) and NoSQL databases (e.g., MongoDB, Redis)

  • Experience with caching strategies (e.g., Redis, Memcached)

  • Proficient in Docker building, managing, and deploying containers

  • Familiarity with data processing frameworks (e.g., Apache Kafka, Spark) is a plus

  • Experience with CI/CD tools and version control (e.g., Git/GitHub)

Preferred Qualifications:
  • Experience with Kubernetes for orchestration of containerized workloads

  • Background working on internal enterprise platforms or workflow systems

  • Knowledge of data governance, encryption, and compliance best practices

  • Strong scripting skills in Python , Bash , or similar

  • Experience in the Oil & Gas industry is a plus

Job Tags

Similar Jobs

Cohen Law Group

Legal Assistant - Intern Job at Cohen Law Group

 ...Job Description Established and thriving firm in Maitland seeks to fill a position for an intern.We are a unique firm that values our clients and staff much like family. Responsibilities: Calendaring, scheduling, communicating specific and accurate data Filing... 

Dignity Health

CNA Job at Dignity Health

 ...St. Bernardine Medical Center as a Certified Nursing Assistant (CNA), where you will play a vital role in supporting nursing staff and...  ...basic nursing care to assigned patients in accordance with hospital policies and procedures.+ Demonstrate understanding of developmental... 

Pacific Aviation

Baggage Handler MYR Job at Pacific Aviation

 ...delivering exceptional service for some of the worlds leading airlines. For over 25 years, weve built our success by investing in our...  ...company with over 25 years of airport service excellence, where your work directly supports airline operations Hands-On Experience:... 

Masego

Instructor (FSA-L4) NGA - St Louis Job at Masego

Job ID: 20221026202228 Location: St. Louis, MO Specialty: NGA's Leadership and Supervisory Learning Solutions Program (LSLSP); Facilitation, Instruction, and Course Development and Maintenance Travel: some travel to all NGA locations, including on weekends and...

Reyes Coca-Cola Bottling

Order Builder Job at Reyes Coca-Cola Bottling

Responsibilities: Join the leading beverage provider, Reyes Coca-Cola Bottling! Shift: Full Time, Second shift with start time of 1:00pm Hourly Pay Rate: $20.00 If you enjoy our products, youll really enjoy being a part of our team! Position Responsibilities:...