Data Engineering Tech Lead - Hadoop Job at Cloud Analytics Technologies LLC, Cleveland, OH

ZkVHN0dkTm8zUVdjZ0lXZ0dlL3RlaG5xaHc9PQ==
  • Cloud Analytics Technologies LLC
  • Cleveland, OH

Job Description

Key Roles & Responsibilities

  • Lead and oversee the end-to-end design, implementation, and optimization of  data pipelines supporting key customer onboarding, transaction, and decisioning workflows.
  • Architect and implement  data ingestion, transformation, and storage frameworks leveraging  Hadoop Avro , and distributed data processing technologies.
  • Partner with product, analytics, and technology teams to translate business requirements into scalable data engineering solutions that enhance real-time data accessibility and reliability.
  • Provide  technical leadership and mentorship to a team of data engineers, ensuring adherence to coding, performance, and data quality standards.
  • Design and implement robust data frameworks to support next-generation customer and business product launches.
  • Develop best practices for  data governance security , and  compliance aligned with enterprise and regulatory requirements.
  • Drive optimization of existing data pipelines and workflows for improved efficiency, scalability, and maintainability.
  • Collaborate closely with analytics and risk modeling teams to ensure data readiness for predictive insights and strategic decision-making.
  • Evaluate and integrate emerging data technologies to future-proof the data platform and enhance performance.

Must-Have Skills

  • 8–10 years of experience in  data engineering , with at least 2–3 years in a technical leadership role .
  • Strong expertise in the  Hadoop ecosystem (HDFS, Hive, MapReduce, HBase, Pig, etc.).
  • Experience working with  Avro Parquet , or other serialization formats.
  • Proven ability to design and maintain  ETL / ELT pipelines using tools such as  Spark Flink Airflow , or  NiFi .
  • Proficiency in  Python Scala for large-scale data processing.
  • Strong understanding of  data modeling data warehousing , and  data lake architectures.
  • Hands-on experience with  SQL and both  relational and  NoSQL data stores.
  • Cloud data platform experience with  AWS .
  • Deep understanding of  data security compliance , and  governance frameworks .
  • Excellent problem-solving, communication, and leadership skills.

Job Tags

Similar Jobs

City of Dover

26-040 Utilities Supervisor, Full-Time Job at City of Dover

 ...systems; oversight of the Citys Water Service Line Inventory compliance program; planning, scheduling, and supervising crews and contractors; engaged in water utility inspection; maintenance; sewer system operations; and compliance activities to ensure the safety,... 

Duolingo

Social Content Creator, Intern Job at Duolingo

 ...short-form video, text, and image content on a fast-paced team Contribute to social and other marketing projects with guidance tailored to your personal growth Learn about social media marketing standards and strategies, and develop exciting and engaging content... 

Bishop Arts Theatre

Sales & Digital Marketing Manager Job at Bishop Arts Theatre

The Sales & Digital Marketing Manager is responsible for driving ticket revenue, expanding audience reach, and strengthening the Bishop...  ...development, preferably in performing arts, entertainment, or nonprofit sectors Proven track record of meeting or exceeding revenue,... 

CUT Beverly Hills

Pastry Cook Job at CUT Beverly Hills

 ...items in accordance with the Wolfgang Puck brand. Uphold cleanliness and organization in all pastry areas, ensuring compliance with food safety and sanitation standards. Collaborate with the Executive Chef, Pastry Chef and culinary team to support seasonal and... 

Tekarch technology

Automated QA Tester Job at Tekarch technology

 ...Program Highlights:Demo on 29th October 2025Basics of Java for registered candidates (Starting Oct 30th, 2025)Access to recorded videos of all sessionsDaily live classes and workshops with a dedicated trainerHands-on Live ProjectsDaily homework and assignments...