Dow Technologies and Systems – Hadoop Developer

We are looking for a Hadoop developer to help us build large-scale data storage and processing software and infrastructure. Knowledge of existing tools is essential, as is the capacity to write software using the Hadoop API. Lead the architecture, design, and development of components and services to enable Machine Learning at scale. Responsible for data ingestion from disparate data sources like SAP sources and non-SAP sources such as iEnergy, MDMS and maintaining and extending the big data platform infrastructure that supports client’s business use cases. Identify and recommend the most appropriate paradigms and technology choices for batch and real-time scenarios. Work on finding cluster level solutions for our complex system and developed enterprise level applications followed by unit testing. Building the pipelines from Source to SFTP, SFTP to Hadoop landing layer using Talend. Develop an automated data ingestion framework using Talend to synchronize the Hadoop data with SAP HANA and vice-versa.

3+ years Experience with minimum of bachelor's degree in computer science or equivalent. Cloudrea Hadoop(CDH), Cloudera Manager, Informatica Bigdata Edition(BDM), HDFS, Yarn, MapReduce, Hive, Impala, KUDU, Sqoop, Spark, Kafka, HBase, Teradata Studio Express, Teradata, Tableau, Kerberos, Active Directory, Sentry, TLS/SSL, Linux/RHEL, Unix Windows, SBT, Maven, Jenkins, Oracle, MS SQL Server, Shell Scripting, Eclipse IDE, Git, SVN Must have strong problem-solving and analytical skills Must have the ability to identify complex problems and review related information to develop and evaluate options and implement solutions.