BI Developer

at Rakuten (view profile)
Location Setagaya City, Japan
Date Posted November 28, 2019
Category Japan - Working visa Jobs
Job Type sql
hadoop
etl
business-intelligence
teradata

Description

We are looking for a BI Developer in the Data Platform Department. The candidate should have experience in the modelling, visualization and querying of data for Business Intelligence purposes over a Big Data (Data Lake + Mart) environment. The ideal candidate should also have an understanding or some experience with both traditional and Big Data pipeline ETL/ELT.  As we are moving to a common/standardized schema view of our data, the primary skill set we are seeking is in data modelling and the implementation of performant marts over a global Data Lake platform. Contingent with this is the ability to engage face-to-face with business stakeholders in analysis. The data platform comprises Teradata and Hadoop clusters with a BI layer of Teradata, Hive, Spark, Presto, AtScale, Tableau, Domo and Microstrategy. This is a challenging Dev/Ops management role where the candidate will also assist in the maintenance of production systems, addressing production issues--adhoc and ticketed—and also expanding the new Hadoop based data platform.

Responsibilities:

  • Analyse and document business requirements of BI initiatives
  • Help build and promote an enterprise schema architecture within the department, conducting workshops with business representatives on refactoring and rebuilding opportunities
  • Assess the pros and cons of different modelling methodologies
  • Model and implement new and existing marts to a common schema architecture over Teradata and Hadoop data sources
  • Produce data visualizations and train users in the use of BI technologies
  • General maintenance and troubleshooting of mart population and ingestion pipelines, on a rotational on-call basis in a 24x7x365 environment
  • Continuous improvement initiatives in data presentation, integrity and availability
  • Provide technical mentorship of team members
     

Minimum Qualifications:

  • B.S. in Computer Science or in related fields
  • More than 3 years’ experience in modeling and developing of BI solutions over Data Lake and DW environments
  • Understanding of different modelling paradigms, such as ER Hybrid, Kimball, Datavault
  • Expert SQL capability in querying Big Data/large data sets (Teradata, Hadoop, etc.) to extract BI- insights
  • BI reporting tools, including administration, modeling, and report/dashboard development
  • Experience in building BI Metadata/Self Service layer
  • Spark SQL development experience
  • Data centric programming experience in languages such as Python/PLSQL/T-SQL
  • Experience working with big data technologies such as Spark, Map Reduce, Hive, Kafka, Sqoop, NoSQL Databases, as well as traditional DB and file based data integration solutions
  • Traditional database development (e.g. TeraData, Oracle, MySQL, SQLServer, DB2, etc.)
  • Shell-scripting languages such as Bash
  • Formal analysis and documentation of BI solutions
  • Distributed version control system such as Git, SVN
  • Initiative and the ability to work independently in a fast-paced team and work environment (we are an Agile environment)

Preferred Qualifications:

  • Application development using workflow engines such as Airflow, Oozie, or Rundeck
  • Experience with Scala and/or Java
  • Experience in ELK Stack
  • Capability to self-manage
  • Teradata, Informatica
  • Technical project management experience

Visa Assistance

Open to assisting the right candidate with the following Visa(s) / Work Permit(s)

1) Japan - Working visa Jobs

Drop files here browse files ...