Big Data Developer

 Responsibilities

• Develop and maintain data pipelines implementing ETL processes
• Take responsibility for Hadoop development and implementation
• Work closely with a data science team implementing data analytic pipelines
• Help define data governance policies and support data versioning processes
• Maintain security and data privacy working closely with Data Protection Officer internally
• Analyze a vast number of data stores and uncover insights

Requirements

• Experience in Python, Spark and Hive
• Understanding of data warehousing and data modeling techniques
• Knowledge of industry-wide analytical and visualization tools (Tableau and R)
• Strong data engineering skills on the Azure Cloud Platform is essential
• Streaming frameworks like Kafka
• Knowledge of core Java, Linux, SQL, and any scripting language
• Good interpersonal skills and positive attitude