Data Engineer

Sunnyvale, CA

Job Description

• The Data Engineer will Design, build, and implement processes, platforms and support critical enterprise Business Intelligence ETL solutions to our in-house Hadoop data stores utilizing Talend, Python, Hive, and Spark.

• Proficiency to understand the Business Queries and derive the data from our Data Lake.

• Ensure data integrity by setting up, maintaining, and auditing SLAs according to the needs of the data consumer.

• Troubleshoot system bugs and problems with data, interfaces, reporting, and workflows.

• Single point of contact in Building and Maintaining the Data warehouse Environment.


    • . At least 2 years’ experience in working with ETL, Data Engineering, or BI handling large volumes of data.

    • Advanced working experience and ability to write complex analytical SQL and HQL queries in some traditional RDBMS and on Hive.

    • Expertise in designing and developing scalable enterprise level ETL solutions and products using Talend, Oozie or Airflow.

    • Familiarity with traditional data warehouses, data cubes, OLTP and OLAP systems and ETL processes that populate them.

    • Knowledge of No-SQL Database like Cassandra.

    • Experienced in Core Java concepts and development experience.

    • Experience designing systems, workflows, and processes that use Big Data technologies such as Hadoop, Hive, HBase, Pig, Flume, Sqoop, and Scala.

    • Scripting development experience with Unix Bash, Python.

    • Experience with the Agile development process.


    Bachelor’s Degree in some technical field required (e.g. Engineering, Math/Stats, Computer Science).